By type
Policy clamp config file: /opt/app/policy/clamp/etc/mounted/KubernetesParticipantParameters.yaml overriding logback xml files . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.0) 2021-12-01 12:11:19.240 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Starting Application using Java 11.0.11 on dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds with PID 9 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) 2021-12-01 12:11:19.247 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : No active profile set, falling back to default profiles: default 2021-12-01 12:11:22.768 INFO 9 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8083 (https) 2021-12-01 12:11:22.795 INFO 9 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2021-12-01 12:11:22.795 INFO 9 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.45] 2021-12-01 12:11:22.933 INFO 9 --- [ main] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2021-12-01 12:11:22.933 INFO 9 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 3557 ms 2021-12-01 12:11:25.517 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2021-12-01 12:11:27.518 INFO 9 --- [ main] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@46185a1b, org.springframework.security.web.context.SecurityContextPersistenceFilter@7979b8b7, org.springframework.security.web.header.HeaderWriterFilter@48840594, org.springframework.security.web.authentication.logout.LogoutFilter@44e93c1f, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@dc79225, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@1bc49bc5, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@2def7a7a, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@51288417, org.springframework.security.web.session.SessionManagementFilter@113e13f9, org.springframework.security.web.access.ExceptionTranslationFilter@eca6a74, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@21079a12] 2021-12-01 12:11:28.285 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstobjectca [jdk]] and DN [CN=UTN-USERFirst-Object, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:40:36 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.286 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [deutschetelekomrootca2 [jdk]] and DN [CN=Deutsche Telekom Root CA 2, OU=T-TeleSec Trust Center, O=Deutsche Telekom AG, C=DE] is not valid due to [NotAfter: Tue Jul 09 23:59:00 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.287 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [identrustdstx3 [jdk]] and DN [CN=DST Root CA X3, O=Digital Signature Trust Co.] is not valid due to [NotAfter: Thu Sep 30 14:01:15 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.287 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustexternalca [jdk]] and DN [CN=AddTrust External CA Root, OU=AddTrust External TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:48:38 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.288 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstclientauthemailca [jdk]] and DN [CN=UTN-USERFirst-Client Authentication and Email, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 17:36:58 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.288 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [verisigntsaca [jdk]] and DN [CN=Thawte Timestamping CA, OU=Thawte Certification, O=Thawte, L=Durbanville, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.289 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [gtecybertrustglobalca [jdk]] and DN [CN=GTE CyberTrust Global Root, OU="GTE CyberTrust Solutions, Inc.", O=GTE Corporation, C=US] is not valid due to [NotAfter: Mon Aug 13 23:59:00 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.289 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [luxtrustglobalrootca [jdk]] and DN [CN=LuxTrust Global Root, O=LuxTrust s.a., C=LU] is not valid due to [NotAfter: Wed Mar 17 09:51:37 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.290 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [soneraclass2ca [jdk]] and DN [CN=Sonera Class2 CA, O=Sonera, C=FI] is not valid due to [NotAfter: Tue Apr 06 07:29:40 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.290 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureglobalebusinessca1 [jdk]] and DN [CN=Equifax Secure Global eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.291 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass3pprimaryca [jdk]] and DN [CN=Class 3P Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.292 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [thawtepremiumserverca [jdk]] and DN [EMAILADDRESS=premium-server@thawte.com, CN=Thawte Premium Server CA, OU=Certification Services Division, O=Thawte Consulting cc, L=Cape Town, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.292 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureebusinessca1 [jdk]] and DN [CN=Equifax Secure eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.293 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureca [jdk]] and DN [OU=Equifax Secure Certificate Authority, O=Equifax, C=US] is not valid due to [NotAfter: Wed Aug 22 16:41:51 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.294 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [quovadisrootca [jdk]] and DN [CN=QuoVadis Root Certification Authority, OU=Root Certification Authority, O=QuoVadis Limited, C=BM] is not valid due to [NotAfter: Wed Mar 17 18:33:33 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.294 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustclass1ca [jdk]] and DN [CN=AddTrust Class 1 CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:38:31 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.295 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass2primaryca [jdk]] and DN [CN=Class 2 Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.295 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [keynectisrootca [jdk]] and DN [CN=KEYNECTIS ROOT CA, OU=ROOT, O=KEYNECTIS, C=FR] is not valid due to [NotAfter: Tue May 26 00:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.296 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirsthardwareca [jdk]] and DN [CN=UTN-USERFirst-Hardware, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:19:22 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.296 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustqualifiedca [jdk]] and DN [CN=AddTrust Qualified CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:44:50 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-01 12:11:28.321 INFO 9 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8083 (https) with context path '' 2021-12-01 12:11:28.784 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting 2021-12-01 12:11:28.784 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic endpoint management 2021-12-01 12:11:28.790 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 2021-12-01 12:11:28.792 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2021-12-01 12:11:28.800 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:11:28.797 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineBusTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=d33bdeed-c29a-4e14-9544-d438075ecdf9, alive=false, publisher=null]]: starting 2021-12-01 12:11:28.806 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:11:28.812 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineDmaapTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=d33bdeed-c29a-4e14-9544-d438075ecdf9, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 2021-12-01 12:11:28.812 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Publisher ParticipantMessagePublisher 2021-12-01 12:11:28.813 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantStatusReqListener 2021-12-01 12:11:28.813 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantUpdateListener 2021-12-01 12:11:28.813 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopUpdateListener 2021-12-01 12:11:28.813 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantRegisterAckListener 2021-12-01 12:11:28.814 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopStateChangeListener 2021-12-01 12:11:28.814 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantDeregisterAckListener 2021-12-01 12:11:28.814 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic Message Dispatcher 2021-12-01 12:11:28.814 INFO 9 --- [ main] o.o.p.c.e.e.comm.bus.internal.TopicBase : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@2e766822 2021-12-01 12:11:28.814 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted 2021-12-01 12:11:28.814 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager started 2021-12-01 12:11:28.825 INFO 9 --- [ main] o.o.p.c.u.services.OrderedServiceImpl : ***** OrderedServiceImpl implementers: [] 2021-12-01 12:11:28.827 INFO 9 --- [ main] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"9ac007a6-a187-4248-a9f9-3d972b770f70","timestamp":"2021-12-01T12:11:28.814910Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2021-12-01 12:11:28.836 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Started Application in 10.985 seconds (JVM running for 12.306) 2021-12-01 12:11:28.838 INFO 9 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state LivenessState changed to CORRECT 2021-12-01 12:11:28.842 INFO 9 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state ReadinessState changed to ACCEPTING_TRAFFIC 2021-12-01 12:11:28.969 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 140 ms 2021-12-01 12:11:28.974 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:30.015 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:30.016 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:11:30.016 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:11:30.017 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:30.024 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:30.024 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:31.062 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 2233 ms 2021-12-01 12:11:31.066 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:31.066 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:32.095 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:32.150 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:32.150 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:33.163 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 4333 ms 2021-12-01 12:11:33.163 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:33.164 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:34.175 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:34.177 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:34.177 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:35.212 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 6383 ms 2021-12-01 12:11:35.213 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:35.213 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:36.223 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:36.224 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:36.225 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:37.264 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 8435 ms 2021-12-01 12:11:37.266 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:37.267 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:38.306 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:38.307 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:38.308 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:39.365 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 10536 ms 2021-12-01 12:11:39.365 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:39.365 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:40.385 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:40.387 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:40.388 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:41.413 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 12584 ms 2021-12-01 12:11:41.413 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:41.413 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:42.430 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:42.433 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:42.434 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:43.465 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 14636 ms 2021-12-01 12:11:43.466 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:43.466 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:44.477 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:44.479 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:44.480 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:45.021 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:11:45.022 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:11:45.023 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:45.023 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:11:45.512 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 16683 ms 2021-12-01 12:11:45.512 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:45.513 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:46.047 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:46.048 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:11:46.048 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:11:46.525 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:46.528 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:46.529 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:47.562 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 18733 ms 2021-12-01 12:11:47.562 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:47.563 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:48.573 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:48.574 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:48.575 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:49.612 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 20783 ms 2021-12-01 12:11:49.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:49.613 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:50.625 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:50.626 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:50.627 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:50.627 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. 2021-12-01 12:11:51.662 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 22833 ms 2021-12-01 12:11:51.662 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:51.663 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:52.669 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:52.670 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:52.671 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:52.671 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. 2021-12-01 12:11:53.712 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 24883 ms 2021-12-01 12:11:53.712 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:53.713 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:54.718 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:54.719 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:54.719 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:54.720 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. 2021-12-01 12:11:55.762 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 26933 ms 2021-12-01 12:11:55.763 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:55.763 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:56.768 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:56.769 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:56.770 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:56.770 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. 2021-12-01 12:11:57.813 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 28984 ms 2021-12-01 12:11:57.813 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:57.813 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:11:58.849 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:11:58.850 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:11:58.850 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:11:58.850 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. 2021-12-01 12:11:59.862 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 31033 ms 2021-12-01 12:11:59.862 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:11:59.862 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:00.893 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:00.894 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:00.894 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:00.894 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. 2021-12-01 12:12:01.049 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:12:01.050 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:12:01.050 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:01.050 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:12:01.912 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 33083 ms 2021-12-01 12:12:01.912 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:01.913 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:02.081 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:02.082 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:12:02.082 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:12:04.957 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:04.958 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:04.958 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:04.958 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. 2021-12-01 12:12:05.962 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 37133 ms 2021-12-01 12:12:05.962 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:05.962 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:06.973 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:06.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:06.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:06.974 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. 2021-12-01 12:12:08.012 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 39183 ms 2021-12-01 12:12:08.012 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:08.013 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:09.021 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:09.022 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:09.022 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:09.022 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. 2021-12-01 12:12:10.062 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 41233 ms 2021-12-01 12:12:10.062 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:10.062 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:11.069 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:11.070 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:11.071 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:11.071 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. 2021-12-01 12:12:12.112 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 43283 ms 2021-12-01 12:12:12.113 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:12.114 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:13.117 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:13.119 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:13.119 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:13.119 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. 2021-12-01 12:12:14.162 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 45333 ms 2021-12-01 12:12:14.162 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:14.163 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:15.165 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:15.166 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:15.166 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:15.166 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. 2021-12-01 12:12:16.212 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 47383 ms 2021-12-01 12:12:16.212 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:16.212 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:17.083 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:12:17.085 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:12:17.085 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:17.085 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:12:17.245 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:17.246 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:17.246 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:17.246 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. 2021-12-01 12:12:18.111 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:18.112 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:12:18.112 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:12:18.262 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 49433 ms 2021-12-01 12:12:18.263 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:18.263 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:19.298 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:19.299 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:19.300 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:19.300 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. 2021-12-01 12:12:20.312 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 51483 ms 2021-12-01 12:12:20.312 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:20.312 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:21.345 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:21.346 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:21.346 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:21.346 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. 2021-12-01 12:12:22.362 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 53533 ms 2021-12-01 12:12:22.363 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:22.364 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:23.389 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:23.390 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:23.391 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:23.391 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. 2021-12-01 12:12:24.412 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 55583 ms 2021-12-01 12:12:24.413 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:24.413 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:25.437 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:25.438 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:25.439 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:25.439 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. 2021-12-01 12:12:26.462 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 57633 ms 2021-12-01 12:12:26.463 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:26.463 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:27.485 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:27.487 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:27.487 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:27.487 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. 2021-12-01 12:12:28.512 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 59683 ms 2021-12-01 12:12:28.512 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:28.512 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:29.533 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:29.534 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:29.535 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:29.535 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. 2021-12-01 12:12:30.562 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 61733 ms 2021-12-01 12:12:30.562 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:30.562 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:31.581 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:31.582 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:31.582 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:31.582 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. 2021-12-01 12:12:32.612 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 63783 ms 2021-12-01 12:12:32.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:32.612 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:33.155 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:12:33.157 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:12:33.157 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:33.157 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:12:34.173 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:34.173 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:12:34.174 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:12:35.649 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:35.650 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:35.650 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:35.651 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. 2021-12-01 12:12:36.662 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 67833 ms 2021-12-01 12:12:36.662 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:36.663 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:37.693 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:37.694 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:37.695 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:37.695 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. 2021-12-01 12:12:38.712 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 69883 ms 2021-12-01 12:12:38.714 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:38.714 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:39.746 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:39.746 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:39.747 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:39.747 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. 2021-12-01 12:12:40.762 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 71933 ms 2021-12-01 12:12:40.764 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:40.764 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:41.789 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:41.790 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:41.791 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:41.791 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. 2021-12-01 12:12:42.812 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 73983 ms 2021-12-01 12:12:42.813 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:42.813 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:43.842 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:43.842 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:43.843 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:43.843 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. 2021-12-01 12:12:44.862 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 76033 ms 2021-12-01 12:12:44.862 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:44.862 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:45.890 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:45.891 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:45.892 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:45.892 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. 2021-12-01 12:12:46.912 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 78083 ms 2021-12-01 12:12:46.912 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:46.912 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:47.933 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:47.934 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:47.934 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:47.934 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. 2021-12-01 12:12:48.962 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 80133 ms 2021-12-01 12:12:48.962 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:48.962 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:49.175 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:12:49.176 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:12:49.176 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:49.176 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:12:50.205 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:50.205 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:12:50.206 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:12:52.006 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:52.007 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:52.007 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:52.007 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. 2021-12-01 12:12:53.012 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 84183 ms 2021-12-01 12:12:53.012 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:53.012 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:54.047 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:54.048 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:54.048 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:54.048 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. 2021-12-01 12:12:55.062 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 86233 ms 2021-12-01 12:12:55.062 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:55.063 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:56.097 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:56.098 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:56.098 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:56.098 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. 2021-12-01 12:12:57.113 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 88284 ms 2021-12-01 12:12:57.113 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:57.113 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:12:58.146 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:12:58.147 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:12:58.147 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:12:58.148 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. 2021-12-01 12:12:59.162 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 90333 ms 2021-12-01 12:12:59.162 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:12:59.162 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:00.193 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:00.195 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:00.196 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:00.196 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. 2021-12-01 12:13:01.212 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 92383 ms 2021-12-01 12:13:01.212 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:01.213 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:02.242 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:02.243 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:02.244 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:02.244 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. 2021-12-01 12:13:03.262 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 94433 ms 2021-12-01 12:13:03.263 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:03.263 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:04.285 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:04.287 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:04.288 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:04.288 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. 2021-12-01 12:13:05.208 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:13:05.210 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:13:05.210 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:05.210 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:13:05.312 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 96483 ms 2021-12-01 12:13:05.312 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:05.313 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:06.238 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:06.238 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:13:06.239 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:13:08.350 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:08.351 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:08.352 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:08.352 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. 2021-12-01 12:13:09.362 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 100533 ms 2021-12-01 12:13:09.362 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:09.363 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:10.397 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:10.398 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:10.399 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:10.399 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. 2021-12-01 12:13:11.412 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 102583 ms 2021-12-01 12:13:11.412 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:11.412 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:12.446 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:12.446 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:12.447 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:12.447 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. 2021-12-01 12:13:13.462 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 104633 ms 2021-12-01 12:13:13.462 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:13.463 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:14.493 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:14.494 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:14.494 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:14.494 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. 2021-12-01 12:13:15.512 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 106683 ms 2021-12-01 12:13:15.512 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:15.513 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:16.541 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:16.558 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:16.558 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:16.558 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. 2021-12-01 12:13:17.562 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 108733 ms 2021-12-01 12:13:17.562 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:17.562 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:18.589 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:18.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:18.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:18.590 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. 2021-12-01 12:13:19.612 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 110783 ms 2021-12-01 12:13:19.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:19.612 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:20.637 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:20.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:20.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:20.638 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. 2021-12-01 12:13:21.241 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:13:21.242 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:13:21.242 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:21.243 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:13:21.662 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 112833 ms 2021-12-01 12:13:21.662 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:21.662 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:22.269 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:22.270 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:13:22.270 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:13:24.702 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:24.702 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:24.703 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-01 12:13:24.703 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. 2021-12-01 12:13:25.630 INFO 9 --- [pool-1-thread-1] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"K8sParticipant0","version":"1.0.0"},"timeStamp":"2021-12-01T12:13:25.593380Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"controlLoopInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"363605c0-1573-4c12-9e7e-9c74664a77ac","timestamp":"2021-12-01T12:13:25.593942Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2021-12-01 12:13:25.712 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 116883 ms 2021-12-01 12:13:25.712 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:25.713 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:26.721 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:26.722 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:26.722 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:26.722 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. 2021-12-01 12:13:27.762 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 118933 ms 2021-12-01 12:13:27.762 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:27.762 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:28.765 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:28.766 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:28.766 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:28.766 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. 2021-12-01 12:13:29.812 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 120983 ms 2021-12-01 12:13:29.812 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:29.812 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:30.849 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:30.851 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:30.851 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:30.851 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. 2021-12-01 12:13:31.862 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 123033 ms 2021-12-01 12:13:31.862 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:31.862 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:32.893 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:32.894 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:32.894 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:32.894 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. 2021-12-01 12:13:33.912 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 125083 ms 2021-12-01 12:13:33.912 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:33.912 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:34.941 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:34.942 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:34.942 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:34.942 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. 2021-12-01 12:13:35.962 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 127133 ms 2021-12-01 12:13:35.962 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:35.962 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:36.989 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:36.990 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:36.990 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:36.990 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. 2021-12-01 12:13:37.270 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:13:37.271 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:13:37.271 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:37.271 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:13:38.012 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 129183 ms 2021-12-01 12:13:38.012 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:38.012 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:38.301 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:38.301 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:13:38.302 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:13:39.037 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:39.038 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:39.038 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:39.038 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. 2021-12-01 12:13:40.062 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 131233 ms 2021-12-01 12:13:40.062 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:40.062 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:41.085 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:41.086 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:41.086 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:41.086 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. 2021-12-01 12:13:42.112 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 133283 ms 2021-12-01 12:13:42.112 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:42.112 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:43.133 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:43.134 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:43.134 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:43.134 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. 2021-12-01 12:13:44.162 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 135333 ms 2021-12-01 12:13:44.162 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:44.162 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:45.181 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:45.182 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:45.182 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:45.182 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. 2021-12-01 12:13:46.212 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 137383 ms 2021-12-01 12:13:46.212 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:46.212 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:47.229 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:47.230 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:47.230 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:47.230 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. 2021-12-01 12:13:48.262 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 139433 ms 2021-12-01 12:13:48.262 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:48.263 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:49.277 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:49.282 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:49.283 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:49.283 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. 2021-12-01 12:13:50.312 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 141483 ms 2021-12-01 12:13:50.312 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:50.312 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:51.329 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:51.330 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:51.330 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:51.330 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. 2021-12-01 12:13:52.365 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 143536 ms 2021-12-01 12:13:52.365 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:52.365 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:53.305 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:13:53.306 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:13:53.306 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:53.306 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:13:54.333 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:54.334 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:13:54.334 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:13:55.397 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:55.397 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:55.398 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:55.398 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. 2021-12-01 12:13:56.412 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 147583 ms 2021-12-01 12:13:56.412 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:56.412 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:57.437 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:57.438 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:57.438 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:57.438 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. 2021-12-01 12:13:58.462 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 149633 ms 2021-12-01 12:13:58.462 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:13:58.463 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:13:59.485 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:13:59.486 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:13:59.486 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:13:59.486 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. 2021-12-01 12:14:00.512 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 151683 ms 2021-12-01 12:14:00.513 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:00.514 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:01.533 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:01.534 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:01.535 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:01.535 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. 2021-12-01 12:14:02.562 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 153733 ms 2021-12-01 12:14:02.562 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:02.562 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:03.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:03.582 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:03.583 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:03.583 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. 2021-12-01 12:14:04.612 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 155783 ms 2021-12-01 12:14:04.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:04.613 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:05.633 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:05.634 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:05.634 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:05.634 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. 2021-12-01 12:14:06.665 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 157836 ms 2021-12-01 12:14:06.665 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:06.665 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:07.677 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:07.678 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:07.678 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:07.678 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. 2021-12-01 12:14:08.712 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 159883 ms 2021-12-01 12:14:08.713 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:08.714 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:09.337 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:14:09.338 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:14:09.338 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:09.338 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:14:10.366 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:10.366 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) 2021-12-01 12:14:10.366 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-01 12:14:11.741 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:11.742 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:11.742 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:11.742 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. 2021-12-01 12:14:12.762 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 163933 ms 2021-12-01 12:14:12.763 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:12.763 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:13.790 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:13.791 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:13.791 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:13.791 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. 2021-12-01 12:14:14.812 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 165983 ms 2021-12-01 12:14:14.812 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:14.813 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:15.837 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:15.838 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:15.838 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:15.838 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. 2021-12-01 12:14:16.862 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 168033 ms 2021-12-01 12:14:16.862 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:16.863 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:17.887 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:17.888 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:17.889 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:17.889 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. 2021-12-01 12:14:18.913 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 170084 ms 2021-12-01 12:14:18.914 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:18.914 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:19.937 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:19.943 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:19.943 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:19.943 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. 2021-12-01 12:14:20.966 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 172133 ms 2021-12-01 12:14:20.967 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:20.967 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:21.982 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:21.983 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:21.983 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:21.983 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. 2021-12-01 12:14:23.012 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 174183 ms 2021-12-01 12:14:23.013 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:23.013 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:24.029 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:24.030 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:24.031 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:24.031 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. 2021-12-01 12:14:25.062 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 176233 ms 2021-12-01 12:14:25.062 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:25.062 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:25.368 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=404cd42b-4561-41c4-ae94-f2131b728e39, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-01 12:14:25.372 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 2021-12-01 12:14:25.372 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:25.372 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/404cd42b-4561-41c4-ae94-f2131b728e39/dev-policy-clamp-cl-k8s-ppnt-8695975f96-2s4ds?timeout=15000 (anonymous) ... 2021-12-01 12:14:26.077 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:26.078 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:26.078 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:26.078 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. 2021-12-01 12:14:27.112 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 178283 ms 2021-12-01 12:14:27.112 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:27.113 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:28.125 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:28.126 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:28.126 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:28.126 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. 2021-12-01 12:14:29.162 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 180333 ms 2021-12-01 12:14:29.162 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:29.162 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:30.173 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:30.174 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:30.175 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:30.175 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. 2021-12-01 12:14:31.212 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 182383 ms 2021-12-01 12:14:31.212 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:31.212 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:32.221 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:32.222 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:32.222 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:32.222 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. 2021-12-01 12:14:33.262 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 184433 ms 2021-12-01 12:14:33.262 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:33.262 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:34.269 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:34.270 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:34.271 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:34.271 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. 2021-12-01 12:14:35.312 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 186483 ms 2021-12-01 12:14:35.312 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:35.313 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:36.317 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:36.318 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:36.319 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:36.319 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. 2021-12-01 12:14:37.362 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 188533 ms 2021-12-01 12:14:37.362 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:37.362 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:38.365 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:38.367 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:38.368 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:38.368 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. 2021-12-01 12:14:39.412 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 190583 ms 2021-12-01 12:14:39.413 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:39.421 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:40.445 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:40.446 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:40.446 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:40.446 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. 2021-12-01 12:14:41.462 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 192633 ms 2021-12-01 12:14:41.462 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:41.462 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:42.493 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:42.495 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:42.495 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:42.495 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. 2021-12-01 12:14:43.512 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 194683 ms 2021-12-01 12:14:43.512 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:43.512 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:44.544 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:44.545 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:44.545 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:44.545 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. 2021-12-01 12:14:45.562 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 196733 ms 2021-12-01 12:14:45.562 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:45.562 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:46.589 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:46.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:46.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:46.590 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. 2021-12-01 12:14:47.612 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 198783 ms 2021-12-01 12:14:47.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:47.613 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:48.637 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:48.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-01 12:14:48.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-01 12:14:48.638 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. 2021-12-01 12:14:49.662 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 200833 ms 2021-12-01 12:14:49.662 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-01 12:14:49.662 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-01 12:14:50.686 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-01 12:14:50.686 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.98.2] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.