Policy clamp config file: /opt/app/policy/clamp/etc/mounted/KubernetesParticipantParameters.yaml overriding logback xml files . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.0) 2022-01-16 12:03:08.626 INFO 10 --- [ main] o.o.p.c.c.p.kubernetes.Application : Starting Application using Java 11.0.11 on dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss with PID 10 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) 2022-01-16 12:03:08.631 INFO 10 --- [ main] o.o.p.c.c.p.kubernetes.Application : No active profile set, falling back to default profiles: default 2022-01-16 12:03:11.475 INFO 10 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8083 (https) 2022-01-16 12:03:11.491 INFO 10 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-01-16 12:03:11.492 INFO 10 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.45] 2022-01-16 12:03:11.575 INFO 10 --- [ main] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-01-16 12:03:11.576 INFO 10 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 2850 ms 2022-01-16 12:03:13.665 INFO 10 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2022-01-16 12:03:14.192 INFO 10 --- [ main] o.s.b.a.e.web.EndpointLinksResolver : Exposing 1 endpoint(s) beneath base path '/actuator' 2022-01-16 12:03:15.331 INFO 10 --- [ main] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@791c12e3, org.springframework.security.web.context.SecurityContextPersistenceFilter@506a1372, org.springframework.security.web.header.HeaderWriterFilter@380e1909, org.springframework.security.web.authentication.logout.LogoutFilter@43a09ce2, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@5854a18, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@77c233af, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@5399f6c5, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@b112b13, org.springframework.security.web.session.SessionManagementFilter@6c6017b9, org.springframework.security.web.access.ExceptionTranslationFilter@3ed34ef5, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@5853ca50] 2022-01-16 12:03:15.814 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstobjectca [jdk]] and DN [CN=UTN-USERFirst-Object, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:40:36 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.814 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [deutschetelekomrootca2 [jdk]] and DN [CN=Deutsche Telekom Root CA 2, OU=T-TeleSec Trust Center, O=Deutsche Telekom AG, C=DE] is not valid due to [NotAfter: Tue Jul 09 23:59:00 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.815 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [globalsignr2ca [jdk]] and DN [CN=GlobalSign, O=GlobalSign, OU=GlobalSign Root CA - R2] is not valid due to [NotAfter: Wed Dec 15 08:00:00 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.815 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [identrustdstx3 [jdk]] and DN [CN=DST Root CA X3, O=Digital Signature Trust Co.] is not valid due to [NotAfter: Thu Sep 30 14:01:15 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.815 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustexternalca [jdk]] and DN [CN=AddTrust External CA Root, OU=AddTrust External TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:48:38 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.816 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstclientauthemailca [jdk]] and DN [CN=UTN-USERFirst-Client Authentication and Email, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 17:36:58 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.816 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [verisigntsaca [jdk]] and DN [CN=Thawte Timestamping CA, OU=Thawte Certification, O=Thawte, L=Durbanville, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.817 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [gtecybertrustglobalca [jdk]] and DN [CN=GTE CyberTrust Global Root, OU="GTE CyberTrust Solutions, Inc.", O=GTE Corporation, C=US] is not valid due to [NotAfter: Mon Aug 13 23:59:00 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.817 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [luxtrustglobalrootca [jdk]] and DN [CN=LuxTrust Global Root, O=LuxTrust s.a., C=LU] is not valid due to [NotAfter: Wed Mar 17 09:51:37 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.817 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [soneraclass2ca [jdk]] and DN [CN=Sonera Class2 CA, O=Sonera, C=FI] is not valid due to [NotAfter: Tue Apr 06 07:29:40 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.818 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureglobalebusinessca1 [jdk]] and DN [CN=Equifax Secure Global eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.818 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass3pprimaryca [jdk]] and DN [CN=Class 3P Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.818 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [thawtepremiumserverca [jdk]] and DN [EMAILADDRESS=premium-server@thawte.com, CN=Thawte Premium Server CA, OU=Certification Services Division, O=Thawte Consulting cc, L=Cape Town, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.819 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureebusinessca1 [jdk]] and DN [CN=Equifax Secure eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.819 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureca [jdk]] and DN [OU=Equifax Secure Certificate Authority, O=Equifax, C=US] is not valid due to [NotAfter: Wed Aug 22 16:41:51 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.820 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [quovadisrootca [jdk]] and DN [CN=QuoVadis Root Certification Authority, OU=Root Certification Authority, O=QuoVadis Limited, C=BM] is not valid due to [NotAfter: Wed Mar 17 18:33:33 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.820 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustclass1ca [jdk]] and DN [CN=AddTrust Class 1 CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:38:31 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.820 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass2primaryca [jdk]] and DN [CN=Class 2 Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.821 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [keynectisrootca [jdk]] and DN [CN=KEYNECTIS ROOT CA, OU=ROOT, O=KEYNECTIS, C=FR] is not valid due to [NotAfter: Tue May 26 00:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.821 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirsthardwareca [jdk]] and DN [CN=UTN-USERFirst-Hardware, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:19:22 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.821 WARN 10 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustqualifiedca [jdk]] and DN [CN=AddTrust Qualified CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:44:50 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-01-16 12:03:15.948 INFO 10 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8083 (https) with context path '' 2022-01-16 12:03:16.314 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting 2022-01-16 12:03:16.314 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic endpoint management 2022-01-16 12:03:16.320 INFO 10 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 2022-01-16 12:03:16.321 INFO 10 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2022-01-16 12:03:16.322 INFO 10 --- [ main] o.o.p.c.e.e.c.b.i.InlineBusTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=ed88aa2f-80fb-4ace-b13d-94bf4631fe86, alive=false, publisher=null]]: starting 2022-01-16 12:03:16.323 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:03:16.333 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:03:16.335 INFO 10 --- [ main] o.o.p.c.e.e.c.b.i.InlineDmaapTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=ed88aa2f-80fb-4ace-b13d-94bf4631fe86, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 2022-01-16 12:03:16.335 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Publisher ParticipantMessagePublisher 2022-01-16 12:03:16.336 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantStatusReqListener 2022-01-16 12:03:16.337 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantUpdateListener 2022-01-16 12:03:16.337 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopUpdateListener 2022-01-16 12:03:16.337 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantRegisterAckListener 2022-01-16 12:03:16.337 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopStateChangeListener 2022-01-16 12:03:16.337 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantDeregisterAckListener 2022-01-16 12:03:16.337 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic Message Dispatcher 2022-01-16 12:03:16.338 INFO 10 --- [ main] o.o.p.c.e.e.comm.bus.internal.TopicBase : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@9c93d16 2022-01-16 12:03:16.338 INFO 10 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted 2022-01-16 12:03:16.338 INFO 10 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager started 2022-01-16 12:03:16.349 INFO 10 --- [ main] o.o.p.c.u.services.OrderedServiceImpl : ***** OrderedServiceImpl implementers: [] 2022-01-16 12:03:16.351 INFO 10 --- [ main] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"33f20021-9c59-4e3d-80ba-984824596f22","timestamp":"2022-01-16T12:03:16.338676Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2022-01-16 12:03:16.361 INFO 10 --- [ main] o.o.p.c.c.p.kubernetes.Application : Started Application in 8.743 seconds (JVM running for 9.755) 2022-01-16 12:03:16.428 INFO 10 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state LivenessState changed to CORRECT 2022-01-16 12:03:16.430 INFO 10 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state ReadinessState changed to ACCEPTING_TRAFFIC 2022-01-16 12:03:16.434 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 81 ms 2022-01-16 12:03:16.438 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:17.418 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:17.419 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:03:17.419 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:03:17.449 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:17.455 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:17.456 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:18.483 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 2131 ms 2022-01-16 12:03:18.484 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:18.484 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:19.499 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:19.501 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:19.501 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:20.535 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 4183 ms 2022-01-16 12:03:20.538 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:20.539 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:21.550 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:21.553 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:21.553 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:22.583 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 6231 ms 2022-01-16 12:03:22.584 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:22.584 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:23.593 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:23.595 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:23.595 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:24.633 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 8281 ms 2022-01-16 12:03:24.634 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:24.635 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:25.641 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:25.642 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:25.644 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:26.687 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 10335 ms 2022-01-16 12:03:26.689 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:26.690 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:27.721 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:27.722 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:27.723 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:28.733 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 12381 ms 2022-01-16 12:03:28.733 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:28.733 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:29.737 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:29.738 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:29.738 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:30.783 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 14431 ms 2022-01-16 12:03:30.783 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:30.784 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:31.817 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:31.818 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:31.819 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:32.422 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:03:32.423 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:03:32.423 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:32.424 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:03:32.833 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 16481 ms 2022-01-16 12:03:32.833 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:32.834 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:33.449 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:33.450 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:03:33.450 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:03:33.875 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:33.880 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:33.880 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:34.883 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 18531 ms 2022-01-16 12:03:34.883 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:34.884 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:35.913 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:35.914 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:35.915 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:36.933 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 20581 ms 2022-01-16 12:03:36.933 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:36.934 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:37.963 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:37.963 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:37.964 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:37.964 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. 2022-01-16 12:03:38.983 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 22631 ms 2022-01-16 12:03:38.983 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:38.983 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:40.009 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:40.010 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:40.010 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:40.010 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. 2022-01-16 12:03:41.033 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 24681 ms 2022-01-16 12:03:41.033 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:41.034 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:42.057 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:42.058 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:42.060 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:42.060 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. 2022-01-16 12:03:43.083 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 26731 ms 2022-01-16 12:03:43.083 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:43.084 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:44.105 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:44.106 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:44.106 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:44.106 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. 2022-01-16 12:03:45.133 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 28781 ms 2022-01-16 12:03:45.134 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:45.134 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:46.153 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:46.157 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:46.157 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:46.158 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. 2022-01-16 12:03:47.183 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 30831 ms 2022-01-16 12:03:47.184 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:47.184 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:48.201 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:48.202 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:48.202 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:48.202 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. 2022-01-16 12:03:48.451 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:03:48.451 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:03:48.459 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:48.459 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:03:49.233 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 32881 ms 2022-01-16 12:03:49.234 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:49.234 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:49.482 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:49.482 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:03:49.482 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:03:52.266 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:52.267 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:52.269 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:52.269 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. 2022-01-16 12:03:53.284 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 36931 ms 2022-01-16 12:03:53.284 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:53.284 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:54.314 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:54.315 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:54.316 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:54.316 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. 2022-01-16 12:03:55.333 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 38981 ms 2022-01-16 12:03:55.334 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:55.335 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:56.366 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:56.369 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:56.370 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:56.370 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. 2022-01-16 12:03:57.384 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 41031 ms 2022-01-16 12:03:57.385 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:57.386 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:03:58.410 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:03:58.412 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:03:58.413 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:03:58.413 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. 2022-01-16 12:03:59.433 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 43081 ms 2022-01-16 12:03:59.434 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:03:59.434 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:00.457 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:00.459 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:00.459 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:00.459 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. 2022-01-16 12:04:01.483 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 45131 ms 2022-01-16 12:04:01.484 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:01.484 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:02.509 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:02.510 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:02.510 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:02.511 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. 2022-01-16 12:04:03.534 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 47182 ms 2022-01-16 12:04:03.534 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:03.534 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:04.484 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:04:04.486 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:04:04.486 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:04.486 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:04:04.554 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:04.555 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:04.555 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:04.555 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. 2022-01-16 12:04:05.520 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:05.520 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:04:05.520 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:04:05.584 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 49231 ms 2022-01-16 12:04:05.584 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:05.584 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:06.601 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:06.602 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:06.603 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:06.603 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. 2022-01-16 12:04:07.633 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 51281 ms 2022-01-16 12:04:07.633 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:07.634 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:08.652 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:08.653 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:08.653 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:08.653 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. 2022-01-16 12:04:09.684 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 53332 ms 2022-01-16 12:04:09.684 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:09.685 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:10.698 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:10.698 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:10.699 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:10.699 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. 2022-01-16 12:04:11.733 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 55381 ms 2022-01-16 12:04:11.733 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:11.734 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:12.747 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:12.747 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:12.747 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:12.747 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. 2022-01-16 12:04:13.783 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 57431 ms 2022-01-16 12:04:13.783 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:13.783 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:14.796 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:14.797 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:14.797 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:14.798 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. 2022-01-16 12:04:15.833 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 59481 ms 2022-01-16 12:04:15.833 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:15.833 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:16.841 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:16.842 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:16.843 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:16.843 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. 2022-01-16 12:04:17.883 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 61531 ms 2022-01-16 12:04:17.883 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:17.884 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:18.892 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:18.908 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:18.909 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:18.929 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. 2022-01-16 12:04:19.933 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 63581 ms 2022-01-16 12:04:19.935 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:19.938 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:20.521 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:04:20.525 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:04:20.525 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:20.526 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:04:21.545 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:21.546 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:04:21.546 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:04:22.985 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:22.987 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:22.987 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:22.987 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. 2022-01-16 12:04:24.033 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 67681 ms 2022-01-16 12:04:24.033 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:24.033 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:25.068 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:25.068 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:25.069 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:25.069 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. 2022-01-16 12:04:26.083 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 69731 ms 2022-01-16 12:04:26.083 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:26.083 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:27.113 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:27.115 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:27.115 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:27.115 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. 2022-01-16 12:04:28.137 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 71785 ms 2022-01-16 12:04:28.137 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:28.137 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:29.183 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:29.184 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:29.185 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:29.186 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. 2022-01-16 12:04:30.189 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 73837 ms 2022-01-16 12:04:30.197 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:30.197 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:31.210 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:31.215 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:31.219 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:31.219 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. 2022-01-16 12:04:32.233 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 75881 ms 2022-01-16 12:04:32.234 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:32.237 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:33.258 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:33.261 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:33.264 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:33.270 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. 2022-01-16 12:04:34.284 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 77932 ms 2022-01-16 12:04:34.285 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:34.285 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:35.305 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:35.307 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:35.307 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:35.307 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. 2022-01-16 12:04:36.333 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 79981 ms 2022-01-16 12:04:36.333 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:36.333 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:36.547 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:04:36.550 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:04:36.550 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:36.550 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:04:37.577 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:37.578 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:04:37.578 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:04:39.369 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:39.371 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:39.371 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:39.371 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. 2022-01-16 12:04:40.383 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 84031 ms 2022-01-16 12:04:40.383 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:40.384 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:41.418 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:41.419 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:41.419 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:41.419 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. 2022-01-16 12:04:42.433 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 86081 ms 2022-01-16 12:04:42.434 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:42.435 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:43.465 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:43.466 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:43.467 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:43.467 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. 2022-01-16 12:04:44.483 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 88131 ms 2022-01-16 12:04:44.483 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:44.484 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:45.513 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:45.514 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:45.514 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:45.515 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. 2022-01-16 12:04:46.533 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 90181 ms 2022-01-16 12:04:46.534 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:46.534 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:47.562 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:47.564 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:47.564 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:47.564 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. 2022-01-16 12:04:48.586 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 92233 ms 2022-01-16 12:04:48.586 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:48.586 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:49.609 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:49.610 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:49.610 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:49.610 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. 2022-01-16 12:04:50.633 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 94281 ms 2022-01-16 12:04:50.633 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:50.633 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:51.657 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:51.658 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:51.658 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:51.658 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. 2022-01-16 12:04:52.579 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:04:52.579 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:04:52.580 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:52.580 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:04:52.683 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 96331 ms 2022-01-16 12:04:52.683 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:52.683 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:53.609 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:53.609 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:04:53.609 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:04:55.721 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:55.722 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:55.723 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:55.723 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. 2022-01-16 12:04:56.733 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 100381 ms 2022-01-16 12:04:56.733 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:56.734 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:57.737 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:57.738 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:57.739 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:57.739 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. 2022-01-16 12:04:58.783 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 102431 ms 2022-01-16 12:04:58.783 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:04:58.784 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:04:59.817 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:04:59.818 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:04:59.818 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:04:59.818 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. 2022-01-16 12:05:00.833 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 104481 ms 2022-01-16 12:05:00.833 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:00.834 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:01.865 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:01.866 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:01.866 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:05:01.866 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. 2022-01-16 12:05:02.883 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 106531 ms 2022-01-16 12:05:02.883 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:02.884 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:03.917 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:03.918 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:03.918 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:05:03.918 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. 2022-01-16 12:05:04.933 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 108581 ms 2022-01-16 12:05:04.933 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:04.933 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:05.962 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:05.963 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:05.963 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:05:05.963 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. 2022-01-16 12:05:06.983 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 110631 ms 2022-01-16 12:05:06.983 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:06.983 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:08.013 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:08.015 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:08.015 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:05:08.015 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. 2022-01-16 12:05:08.610 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:05:08.611 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:05:08.611 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:08.611 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:05:09.033 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 112681 ms 2022-01-16 12:05:09.033 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:09.033 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:09.645 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:09.645 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:05:09.645 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:05:12.073 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:12.074 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:12.074 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:05:12.074 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. 2022-01-16 12:05:13.083 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 116731 ms 2022-01-16 12:05:13.083 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:13.083 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:13.778 INFO 10 --- [pool-1-thread-1] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"K8sParticipant0","version":"1.0.0"},"timeStamp":"2022-01-16T12:05:13.731034Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"controlLoopInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"0e978992-fab8-4927-99e7-8004253a8c34","timestamp":"2022-01-16T12:05:13.732064Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2022-01-16 12:05:14.089 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:14.090 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:14.090 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-01-16 12:05:14.090 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. 2022-01-16 12:05:15.133 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 118781 ms 2022-01-16 12:05:15.133 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:15.134 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:16.142 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:16.143 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:16.143 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:16.143 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. 2022-01-16 12:05:17.183 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 120831 ms 2022-01-16 12:05:17.183 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:17.184 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:18.217 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:18.218 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:18.218 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:18.218 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. 2022-01-16 12:05:19.233 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 122881 ms 2022-01-16 12:05:19.233 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:19.234 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:20.265 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:20.266 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:20.266 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:20.266 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. 2022-01-16 12:05:21.283 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 124931 ms 2022-01-16 12:05:21.283 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:21.284 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:22.314 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:22.316 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:22.316 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:22.316 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. 2022-01-16 12:05:23.333 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 126981 ms 2022-01-16 12:05:23.334 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:23.334 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:24.363 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:24.365 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:24.365 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:24.365 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. 2022-01-16 12:05:24.649 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:05:24.651 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:05:24.652 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:24.653 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:05:25.383 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 129031 ms 2022-01-16 12:05:25.385 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:25.385 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:25.674 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:25.674 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:05:25.675 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:05:26.409 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:26.412 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:26.412 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:26.412 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. 2022-01-16 12:05:27.433 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 131081 ms 2022-01-16 12:05:27.433 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:27.433 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:28.457 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:28.464 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:28.464 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:28.464 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. 2022-01-16 12:05:29.483 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 133131 ms 2022-01-16 12:05:29.483 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:29.483 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:30.506 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:30.507 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:30.507 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:30.507 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. 2022-01-16 12:05:31.533 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 135181 ms 2022-01-16 12:05:31.533 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:31.534 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:32.557 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:32.561 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:32.561 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:32.561 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. 2022-01-16 12:05:33.583 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 137231 ms 2022-01-16 12:05:33.583 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:33.584 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:34.601 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:34.602 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:34.602 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:34.602 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. 2022-01-16 12:05:35.633 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 139281 ms 2022-01-16 12:05:35.633 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:35.633 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:36.655 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:36.656 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:36.656 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:36.656 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. 2022-01-16 12:05:37.683 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 141331 ms 2022-01-16 12:05:37.683 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:37.684 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:38.697 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:38.698 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:38.698 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:38.698 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. 2022-01-16 12:05:39.733 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 143381 ms 2022-01-16 12:05:39.733 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:39.733 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:40.676 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:05:40.677 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:05:40.677 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:40.677 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:05:41.705 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:41.705 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:05:41.706 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:05:42.761 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:42.762 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:42.762 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:42.762 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. 2022-01-16 12:05:43.783 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 147431 ms 2022-01-16 12:05:43.784 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:43.784 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:44.809 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:44.810 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:44.810 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:44.810 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. 2022-01-16 12:05:45.833 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 149481 ms 2022-01-16 12:05:45.833 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:45.833 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:46.857 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:46.858 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:46.858 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:46.858 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. 2022-01-16 12:05:47.883 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 151531 ms 2022-01-16 12:05:47.883 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:47.884 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:48.905 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:48.906 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:48.906 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:48.906 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. 2022-01-16 12:05:49.933 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 153581 ms 2022-01-16 12:05:49.933 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:49.934 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:50.953 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:50.954 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:50.954 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:50.954 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. 2022-01-16 12:05:51.983 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 155631 ms 2022-01-16 12:05:51.983 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:51.983 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:53.001 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:53.002 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:53.002 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:53.002 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. 2022-01-16 12:05:54.033 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 157681 ms 2022-01-16 12:05:54.033 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:54.033 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:55.049 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:55.051 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:55.051 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:55.051 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. 2022-01-16 12:05:56.083 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 159731 ms 2022-01-16 12:05:56.083 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:56.083 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:05:56.709 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:05:56.710 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:05:56.710 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:05:56.710 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:05:57.741 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:57.742 ERROR 10 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) 2022-01-16 12:05:57.742 INFO 10 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-01-16 12:05:59.113 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:05:59.114 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:05:59.114 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:05:59.114 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. 2022-01-16 12:06:00.133 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 163781 ms 2022-01-16 12:06:00.133 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:00.134 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:01.163 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:01.164 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:01.164 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:01.169 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. 2022-01-16 12:06:02.183 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 165831 ms 2022-01-16 12:06:02.185 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:02.186 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:03.214 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:03.216 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:03.216 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:03.216 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. 2022-01-16 12:06:04.233 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 167881 ms 2022-01-16 12:06:04.233 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:04.234 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:05.258 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:05.260 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:05.261 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:05.261 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. 2022-01-16 12:06:06.283 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 169931 ms 2022-01-16 12:06:06.283 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:06.284 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:07.305 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:07.306 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:07.306 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:07.306 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. 2022-01-16 12:06:08.333 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 171981 ms 2022-01-16 12:06:08.333 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:08.333 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:09.353 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:09.354 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:09.355 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:09.355 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. 2022-01-16 12:06:10.383 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 174031 ms 2022-01-16 12:06:10.383 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:10.384 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:11.401 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:11.402 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:11.402 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:11.403 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. 2022-01-16 12:06:12.433 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 176081 ms 2022-01-16 12:06:12.433 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:12.433 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:12.744 ERROR 10 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c2e12736-f1a0-49c0-8f22-2ca738bb0023, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-01-16 12:06:12.747 INFO 10 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 2022-01-16 12:06:12.747 WARN 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:12.747 INFO 10 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/c2e12736-f1a0-49c0-8f22-2ca738bb0023/dev-policy-clamp-cl-k8s-ppnt-76cb64d9dd-f56ss?timeout=15000 (anonymous) ... 2022-01-16 12:06:13.454 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:13.455 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:13.455 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:13.455 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. 2022-01-16 12:06:14.483 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 178131 ms 2022-01-16 12:06:14.483 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:14.483 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:15.501 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:15.502 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:15.502 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:15.502 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. 2022-01-16 12:06:16.533 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 180181 ms 2022-01-16 12:06:16.533 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:16.533 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:17.549 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:17.550 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:17.550 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:17.550 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. 2022-01-16 12:06:18.583 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 182231 ms 2022-01-16 12:06:18.583 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:18.583 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:19.597 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:19.598 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:19.598 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:19.598 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. 2022-01-16 12:06:20.633 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 184281 ms 2022-01-16 12:06:20.634 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:20.634 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:21.641 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:21.642 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:21.642 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:21.642 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. 2022-01-16 12:06:22.683 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 186331 ms 2022-01-16 12:06:22.683 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:22.683 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:23.689 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:23.690 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:23.691 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:23.691 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. 2022-01-16 12:06:24.733 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 188381 ms 2022-01-16 12:06:24.733 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:24.733 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:25.737 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:25.738 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:25.739 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:25.739 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. 2022-01-16 12:06:26.783 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 190431 ms 2022-01-16 12:06:26.783 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:26.783 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:27.785 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:27.786 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:27.786 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:27.786 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. 2022-01-16 12:06:28.833 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 192481 ms 2022-01-16 12:06:28.833 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:28.833 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:29.865 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:29.866 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:29.866 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:29.866 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. 2022-01-16 12:06:30.883 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 194531 ms 2022-01-16 12:06:30.883 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:30.883 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:31.917 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:31.918 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:31.918 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:31.918 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. 2022-01-16 12:06:32.933 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 196581 ms 2022-01-16 12:06:32.933 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:32.933 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:33.965 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:33.966 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:33.966 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:33.966 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. 2022-01-16 12:06:34.983 INFO 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 198631 ms 2022-01-16 12:06:34.983 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-01-16 12:06:34.984 INFO 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-01-16 12:06:36.009 WARN 10 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-01-16 12:06:36.010 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.185.235] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-01-16 12:06:36.010 WARN 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-01-16 12:06:36.011 ERROR 10 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_