By type
Policy clamp config file: /opt/app/policy/clamp/etc/mounted/KubernetesParticipantParameters.yaml overriding logback xml files . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.0) 2022-03-23 02:08:32.329 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Starting Application using Java 11.0.11 on onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh with PID 9 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) 2022-03-23 02:08:32.333 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : No active profile set, falling back to default profiles: default 2022-03-23 02:08:39.737 INFO 9 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8083 (https) 2022-03-23 02:08:39.810 INFO 9 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2022-03-23 02:08:39.811 INFO 9 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.45] 2022-03-23 02:08:40.022 INFO 9 --- [ main] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2022-03-23 02:08:40.022 INFO 9 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 7414 ms 2022-03-23 02:08:45.151 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2022-03-23 02:08:49.032 INFO 9 --- [ main] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@472a11ae, org.springframework.security.web.context.SecurityContextPersistenceFilter@1442f788, org.springframework.security.web.header.HeaderWriterFilter@f91da5e, org.springframework.security.web.authentication.logout.LogoutFilter@35267fd4, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@36417a54, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@1c7f96b1, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@7b6e5c12, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@dc79225, org.springframework.security.web.session.SessionManagementFilter@6917bb4, org.springframework.security.web.access.ExceptionTranslationFilter@4a67b4ec, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@44bd4b0a] 2022-03-23 02:08:50.156 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstobjectca [jdk]] and DN [CN=UTN-USERFirst-Object, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:40:36 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.156 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [deutschetelekomrootca2 [jdk]] and DN [CN=Deutsche Telekom Root CA 2, OU=T-TeleSec Trust Center, O=Deutsche Telekom AG, C=DE] is not valid due to [NotAfter: Tue Jul 09 23:59:00 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.156 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [globalsignr2ca [jdk]] and DN [CN=GlobalSign, O=GlobalSign, OU=GlobalSign Root CA - R2] is not valid due to [NotAfter: Wed Dec 15 08:00:00 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.157 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [identrustdstx3 [jdk]] and DN [CN=DST Root CA X3, O=Digital Signature Trust Co.] is not valid due to [NotAfter: Thu Sep 30 14:01:15 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.157 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustexternalca [jdk]] and DN [CN=AddTrust External CA Root, OU=AddTrust External TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:48:38 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.157 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstclientauthemailca [jdk]] and DN [CN=UTN-USERFirst-Client Authentication and Email, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 17:36:58 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.157 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [verisigntsaca [jdk]] and DN [CN=Thawte Timestamping CA, OU=Thawte Certification, O=Thawte, L=Durbanville, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.158 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [gtecybertrustglobalca [jdk]] and DN [CN=GTE CyberTrust Global Root, OU="GTE CyberTrust Solutions, Inc.", O=GTE Corporation, C=US] is not valid due to [NotAfter: Mon Aug 13 23:59:00 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.158 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [luxtrustglobalrootca [jdk]] and DN [CN=LuxTrust Global Root, O=LuxTrust s.a., C=LU] is not valid due to [NotAfter: Wed Mar 17 09:51:37 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.158 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [soneraclass2ca [jdk]] and DN [CN=Sonera Class2 CA, O=Sonera, C=FI] is not valid due to [NotAfter: Tue Apr 06 07:29:40 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.158 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureglobalebusinessca1 [jdk]] and DN [CN=Equifax Secure Global eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.158 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass3pprimaryca [jdk]] and DN [CN=Class 3P Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.159 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [thawtepremiumserverca [jdk]] and DN [EMAILADDRESS=premium-server@thawte.com, CN=Thawte Premium Server CA, OU=Certification Services Division, O=Thawte Consulting cc, L=Cape Town, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.159 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureebusinessca1 [jdk]] and DN [CN=Equifax Secure eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.159 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureca [jdk]] and DN [OU=Equifax Secure Certificate Authority, O=Equifax, C=US] is not valid due to [NotAfter: Wed Aug 22 16:41:51 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.159 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [quovadisrootca [jdk]] and DN [CN=QuoVadis Root Certification Authority, OU=Root Certification Authority, O=QuoVadis Limited, C=BM] is not valid due to [NotAfter: Wed Mar 17 18:33:33 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.160 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustclass1ca [jdk]] and DN [CN=AddTrust Class 1 CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:38:31 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.160 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass2primaryca [jdk]] and DN [CN=Class 2 Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.160 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [keynectisrootca [jdk]] and DN [CN=KEYNECTIS ROOT CA, OU=ROOT, O=KEYNECTIS, C=FR] is not valid due to [NotAfter: Tue May 26 00:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.160 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirsthardwareca [jdk]] and DN [CN=UTN-USERFirst-Hardware, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:19:22 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.160 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustqualifiedca [jdk]] and DN [CN=AddTrust Qualified CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:44:50 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2022-03-23 02:08:50.232 INFO 9 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8083 (https) with context path '' 2022-03-23 02:08:51.124 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting 2022-03-23 02:08:51.125 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic endpoint management 2022-03-23 02:08:51.142 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 2022-03-23 02:08:51.144 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2022-03-23 02:08:51.211 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:08:51.220 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:08:51.208 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineBusTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=a4f8fa23-5197-406f-afe5-3c1b8efb8967, alive=false, publisher=null]]: starting 2022-03-23 02:08:51.232 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineDmaapTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=a4f8fa23-5197-406f-afe5-3c1b8efb8967, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 2022-03-23 02:08:51.232 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Publisher ParticipantMessagePublisher 2022-03-23 02:08:51.232 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantStatusReqListener 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantUpdateListener 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopUpdateListener 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantRegisterAckListener 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopStateChangeListener 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantDeregisterAckListener 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic Message Dispatcher 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.e.e.comm.bus.internal.TopicBase : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@13dbed9e 2022-03-23 02:08:51.233 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted 2022-03-23 02:08:51.233 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager started 2022-03-23 02:08:51.442 INFO 9 --- [ main] o.o.p.c.u.services.OrderedServiceImpl : ***** OrderedServiceImpl implementers: [] 2022-03-23 02:08:51.444 INFO 9 --- [ main] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"a08ea7cc-ec48-41de-8f84-567f014a974e","timestamp":"2022-03-23T02:08:51.234121Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2022-03-23 02:08:51.453 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Started Application in 21.811 seconds (JVM running for 23.814) 2022-03-23 02:08:51.454 INFO 9 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state LivenessState changed to CORRECT 2022-03-23 02:08:51.457 INFO 9 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state ReadinessState changed to ACCEPTING_TRAFFIC 2022-03-23 02:08:51.482 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 35 ms 2022-03-23 02:08:51.509 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:08:52.559 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:08:52.561 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:08:52.561 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:08:52.562 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:08:52.568 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:08:52.569 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:08:53.582 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 2135 ms 2022-03-23 02:08:53.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:08:53.583 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:08:54.603 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:08:54.604 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:08:54.604 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:08:55.632 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 4186 ms 2022-03-23 02:08:55.632 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:08:55.632 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:08:56.653 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:08:56.654 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:08:56.655 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:08:57.682 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 6236 ms 2022-03-23 02:08:57.682 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:08:57.683 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:08:58.703 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:08:58.705 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:08:58.705 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:08:59.732 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 8286 ms 2022-03-23 02:08:59.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:08:59.732 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:00.750 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:00.751 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:00.752 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:01.782 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 10336 ms 2022-03-23 02:09:01.782 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:01.782 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:02.801 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:02.803 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:02.803 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:03.831 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 12385 ms 2022-03-23 02:09:03.832 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:03.832 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:04.843 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:04.844 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:04.844 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:05.882 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 14436 ms 2022-03-23 02:09:05.882 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:05.883 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:06.925 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:06.927 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:06.928 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:07.568 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:09:07.569 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:09:07.570 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:07.570 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:09:07.932 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 16485 ms 2022-03-23 02:09:07.932 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:07.933 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:08.618 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:08.618 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:09:08.618 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:09:08.973 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:08.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:08.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:09.982 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 18535 ms 2022-03-23 02:09:09.982 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:09.983 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:11.021 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:11.023 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:11.024 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:12.032 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 20585 ms 2022-03-23 02:09:12.032 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:12.032 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:13.084 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:13.085 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:13.085 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:13.085 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. 2022-03-23 02:09:14.132 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 22685 ms 2022-03-23 02:09:14.132 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:14.133 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:15.147 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:15.147 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:15.147 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:15.148 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. 2022-03-23 02:09:16.182 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 24735 ms 2022-03-23 02:09:16.182 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:16.182 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:17.229 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:17.230 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:17.231 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:17.231 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. 2022-03-23 02:09:18.232 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 26785 ms 2022-03-23 02:09:18.232 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:18.232 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:19.245 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:19.246 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:19.247 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:19.247 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. 2022-03-23 02:09:20.282 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 28835 ms 2022-03-23 02:09:20.282 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:20.283 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:21.293 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:21.294 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:21.295 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:21.295 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. 2022-03-23 02:09:22.332 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 30885 ms 2022-03-23 02:09:22.332 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:22.333 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:23.373 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:23.374 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:23.375 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:23.375 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. 2022-03-23 02:09:23.619 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:09:23.620 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:09:23.621 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:23.621 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:09:24.381 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 32935 ms 2022-03-23 02:09:24.382 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:24.382 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:24.657 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:24.658 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:09:24.658 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:09:27.440 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:27.441 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:27.441 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:27.441 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. 2022-03-23 02:09:28.481 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 37035 ms 2022-03-23 02:09:28.482 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:28.482 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:29.519 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:29.520 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:29.520 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:29.520 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. 2022-03-23 02:09:30.532 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 39085 ms 2022-03-23 02:09:30.532 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:30.532 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:31.562 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:31.563 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:31.563 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:31.563 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. 2022-03-23 02:09:32.582 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 41135 ms 2022-03-23 02:09:32.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:32.582 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:33.616 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:33.617 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:33.617 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:33.617 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. 2022-03-23 02:09:34.631 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 43185 ms 2022-03-23 02:09:34.632 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:34.632 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:35.658 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:35.659 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:35.659 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:35.659 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. 2022-03-23 02:09:36.682 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 45235 ms 2022-03-23 02:09:36.682 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:36.682 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:37.709 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:37.710 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:37.710 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:37.710 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. 2022-03-23 02:09:38.732 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 47285 ms 2022-03-23 02:09:38.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:38.732 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:39.659 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:09:39.660 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:09:39.660 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:39.661 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:09:39.760 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:39.762 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:39.762 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:39.762 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. 2022-03-23 02:09:40.685 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:40.686 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:09:40.686 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:09:40.782 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 49335 ms 2022-03-23 02:09:40.782 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:40.782 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:41.818 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:41.819 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:41.819 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:41.819 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. 2022-03-23 02:09:42.831 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 51385 ms 2022-03-23 02:09:42.832 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:42.832 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:43.852 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:43.853 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:43.854 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:43.854 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. 2022-03-23 02:09:44.881 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 53435 ms 2022-03-23 02:09:44.882 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:44.882 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:45.901 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:45.902 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:45.903 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:45.903 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. 2022-03-23 02:09:46.931 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 55485 ms 2022-03-23 02:09:46.932 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:46.932 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:47.948 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:47.949 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:47.949 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:47.949 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. 2022-03-23 02:09:48.981 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 57535 ms 2022-03-23 02:09:48.982 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:48.982 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:49.995 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:49.996 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:49.996 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:49.997 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. 2022-03-23 02:09:51.033 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 59587 ms 2022-03-23 02:09:51.033 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:51.034 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:52.074 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:52.075 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:52.075 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:52.075 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. 2022-03-23 02:09:53.081 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 61635 ms 2022-03-23 02:09:53.082 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:53.082 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:54.126 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:54.127 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:54.127 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:54.127 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. 2022-03-23 02:09:55.131 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 63685 ms 2022-03-23 02:09:55.132 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:55.132 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:09:55.687 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:09:55.687 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:09:55.687 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:55.688 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:09:56.715 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:56.715 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:09:56.715 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:09:58.162 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:09:58.163 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:09:58.163 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:09:58.163 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. 2022-03-23 02:09:59.182 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 67735 ms 2022-03-23 02:09:59.182 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:09:59.183 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:00.204 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:00.205 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:00.205 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:00.205 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. 2022-03-23 02:10:01.231 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 69785 ms 2022-03-23 02:10:01.232 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:01.232 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:02.253 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:02.253 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:02.253 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:02.253 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. 2022-03-23 02:10:03.282 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 71835 ms 2022-03-23 02:10:03.282 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:03.282 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:04.305 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:04.306 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:04.306 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:04.306 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. 2022-03-23 02:10:05.331 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 73885 ms 2022-03-23 02:10:05.332 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:05.332 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:06.347 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:06.348 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:06.348 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:06.348 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. 2022-03-23 02:10:07.382 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 75935 ms 2022-03-23 02:10:07.382 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:07.382 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:08.395 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:08.395 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:08.396 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:08.396 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. 2022-03-23 02:10:09.431 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 77985 ms 2022-03-23 02:10:09.432 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:09.432 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:10.481 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:10.482 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:10.482 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:10.482 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. 2022-03-23 02:10:11.532 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 80085 ms 2022-03-23 02:10:11.532 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:11.532 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:11.717 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:10:11.718 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:10:11.718 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:11.718 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:10:12.557 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:12.558 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:12.558 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:12.559 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. 2022-03-23 02:10:13.582 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 82135 ms 2022-03-23 02:10:13.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:13.583 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:14.606 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:14.607 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:14.607 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:14.607 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. 2022-03-23 02:10:15.631 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 84185 ms 2022-03-23 02:10:15.632 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:15.632 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:16.650 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:16.652 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:16.652 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:16.652 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. 2022-03-23 02:10:17.682 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 86235 ms 2022-03-23 02:10:17.682 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:17.682 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:18.730 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:18.731 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:18.731 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:18.731 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. 2022-03-23 02:10:19.731 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 88285 ms 2022-03-23 02:10:19.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:19.733 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:20.749 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:20.750 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:20.750 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:20.750 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. 2022-03-23 02:10:21.782 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 90336 ms 2022-03-23 02:10:21.782 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:21.782 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:22.798 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:22.799 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:22.800 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:22.800 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. 2022-03-23 02:10:23.831 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 92385 ms 2022-03-23 02:10:23.832 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:23.832 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:24.881 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:24.886 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:24.887 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:24.887 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. 2022-03-23 02:10:25.931 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 94485 ms 2022-03-23 02:10:25.932 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:25.932 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:26.957 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:26.958 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:26.959 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:26.959 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. 2022-03-23 02:10:27.982 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 96536 ms 2022-03-23 02:10:27.985 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:27.999 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:29.034 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:29.035 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:29.035 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:29.035 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. 2022-03-23 02:10:30.082 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 98635 ms 2022-03-23 02:10:30.082 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:30.082 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:31.117 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:31.119 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:31.119 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:31.119 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. 2022-03-23 02:10:32.131 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 100685 ms 2022-03-23 02:10:32.132 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:32.132 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:33.164 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:33.165 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:33.165 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:33.165 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. 2022-03-23 02:10:34.182 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 102735 ms 2022-03-23 02:10:34.182 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:34.182 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:35.213 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:35.214 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:35.215 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:35.215 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. 2022-03-23 02:10:36.231 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 104785 ms 2022-03-23 02:10:36.232 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:36.232 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:37.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:37.262 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:37.263 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:37.263 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. 2022-03-23 02:10:38.282 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 106835 ms 2022-03-23 02:10:38.282 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:38.282 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:39.305 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:39.306 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:39.306 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:39.306 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. 2022-03-23 02:10:40.331 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 108885 ms 2022-03-23 02:10:40.332 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:40.332 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:41.356 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:41.357 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:41.357 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:41.357 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. 2022-03-23 02:10:42.382 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 110935 ms 2022-03-23 02:10:42.382 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:42.382 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:43.277 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:43.277 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:10:43.277 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:10:43.404 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:43.405 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:43.405 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:43.405 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. 2022-03-23 02:10:44.431 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 112985 ms 2022-03-23 02:10:44.432 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:44.432 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:45.361 INFO 9 --- [pool-1-thread-1] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"K8sParticipant0","version":"1.0.0"},"timeStamp":"2022-03-23T02:10:45.339944Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"controlLoopInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"5a4c0718-5546-46e9-b779-b897a3b0eae1","timestamp":"2022-03-23T02:10:45.340175Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2022-03-23 02:10:45.450 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:45.451 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:45.451 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2022-03-23 02:10:45.451 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. 2022-03-23 02:10:46.482 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 115035 ms 2022-03-23 02:10:46.482 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:46.482 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:47.502 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:47.502 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:47.502 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:47.503 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. 2022-03-23 02:10:48.532 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 117086 ms 2022-03-23 02:10:48.532 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:48.532 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:49.546 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:49.547 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:49.547 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:49.547 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. 2022-03-23 02:10:50.581 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 119135 ms 2022-03-23 02:10:50.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:50.582 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:51.630 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:51.631 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:51.631 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:51.631 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. 2022-03-23 02:10:52.632 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 121185 ms 2022-03-23 02:10:52.632 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:52.632 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:53.648 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:53.648 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:53.649 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:53.649 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. 2022-03-23 02:10:54.682 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 123235 ms 2022-03-23 02:10:54.682 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:54.682 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:55.725 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:55.726 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:55.727 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:55.727 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. 2022-03-23 02:10:56.731 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 125285 ms 2022-03-23 02:10:56.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:56.732 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:57.740 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:57.741 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:57.741 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:57.741 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. 2022-03-23 02:10:58.278 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:10:58.279 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:10:58.279 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:58.279 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:10:58.781 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 127335 ms 2022-03-23 02:10:58.782 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:10:58.782 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:10:59.821 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:10:59.822 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:10:59.824 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:10:59.824 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. 2022-03-23 02:11:00.831 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 129385 ms 2022-03-23 02:11:00.832 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:00.833 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:01.878 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:01.879 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:01.879 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:01.879 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. 2022-03-23 02:11:02.881 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 131435 ms 2022-03-23 02:11:02.882 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:02.882 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:03.918 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:03.919 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:03.919 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:03.919 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. 2022-03-23 02:11:04.931 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 133485 ms 2022-03-23 02:11:04.932 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:04.932 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:05.548 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:05.548 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:11:05.548 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:11:07.978 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:07.979 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:07.979 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:07.979 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. 2022-03-23 02:11:08.982 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 137535 ms 2022-03-23 02:11:08.982 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:08.982 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:09.994 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:09.995 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:09.995 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:09.995 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. 2022-03-23 02:11:11.031 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 139585 ms 2022-03-23 02:11:11.032 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:11.032 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:12.043 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:12.043 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:12.043 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:12.043 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. 2022-03-23 02:11:13.082 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 141635 ms 2022-03-23 02:11:13.082 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:13.082 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:14.090 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:14.091 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:14.091 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:14.091 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. 2022-03-23 02:11:15.131 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 143685 ms 2022-03-23 02:11:15.132 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:15.132 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:16.174 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:16.175 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:16.175 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:16.175 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. 2022-03-23 02:11:17.182 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 145735 ms 2022-03-23 02:11:17.182 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:17.182 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:18.221 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:18.222 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:18.222 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:18.222 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. 2022-03-23 02:11:19.231 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 147785 ms 2022-03-23 02:11:19.232 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:19.232 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:20.267 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:20.267 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:20.267 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:20.267 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. 2022-03-23 02:11:20.549 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:11:20.550 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:11:20.550 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:20.551 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:11:21.281 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 149835 ms 2022-03-23 02:11:21.282 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:21.282 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:21.579 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:21.579 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:11:21.579 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:11:24.332 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:24.333 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:24.333 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:24.333 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. 2022-03-23 02:11:25.382 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 153935 ms 2022-03-23 02:11:25.382 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:25.382 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:26.417 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:26.418 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:26.419 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:26.419 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. 2022-03-23 02:11:27.431 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 155985 ms 2022-03-23 02:11:27.432 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:27.432 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:28.460 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:28.461 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:28.462 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:28.462 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. 2022-03-23 02:11:29.481 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 158035 ms 2022-03-23 02:11:29.482 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:29.482 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:30.509 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:30.510 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:30.510 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:30.510 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. 2022-03-23 02:11:31.531 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 160085 ms 2022-03-23 02:11:31.532 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:31.532 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:32.557 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:32.558 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:32.558 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:32.558 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. 2022-03-23 02:11:33.582 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 162135 ms 2022-03-23 02:11:33.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:33.582 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:34.605 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:34.606 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:34.607 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:34.607 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. 2022-03-23 02:11:35.631 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 164185 ms 2022-03-23 02:11:35.632 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:35.632 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:36.580 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:11:36.581 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:11:36.581 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:36.581 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:11:36.651 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:36.652 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:36.652 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:36.652 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. 2022-03-23 02:11:37.612 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:37.612 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:11:37.613 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:11:37.681 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 166235 ms 2022-03-23 02:11:37.682 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:37.682 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:38.702 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:38.702 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:38.703 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:38.703 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. 2022-03-23 02:11:39.731 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 168285 ms 2022-03-23 02:11:39.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:39.732 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:40.745 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:40.746 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:40.747 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:40.747 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. 2022-03-23 02:11:41.781 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 170335 ms 2022-03-23 02:11:41.782 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:41.782 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:42.797 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:42.798 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:42.798 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:42.798 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. 2022-03-23 02:11:43.832 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 172385 ms 2022-03-23 02:11:43.832 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:43.832 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:44.844 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:44.845 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:44.845 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:44.846 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. 2022-03-23 02:11:45.882 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 174435 ms 2022-03-23 02:11:45.882 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:45.882 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:46.926 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:46.927 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:46.927 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:46.927 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. 2022-03-23 02:11:47.931 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 176485 ms 2022-03-23 02:11:47.932 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:47.932 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:48.973 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:48.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:48.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:48.974 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. 2022-03-23 02:11:49.982 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 178535 ms 2022-03-23 02:11:49.982 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:49.982 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:51.021 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:51.023 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:51.032 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:51.032 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. 2022-03-23 02:11:52.082 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 180635 ms 2022-03-23 02:11:52.082 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:52.082 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:52.613 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:11:52.614 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:11:52.614 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:52.614 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:11:53.645 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:53.645 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:11:53.646 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:11:55.121 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:55.122 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:55.122 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:55.122 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. 2022-03-23 02:11:56.136 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 184690 ms 2022-03-23 02:11:56.136 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:56.137 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:57.164 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:57.165 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:57.165 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:57.165 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. 2022-03-23 02:11:58.182 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 186735 ms 2022-03-23 02:11:58.182 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:11:58.182 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:11:59.213 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:11:59.214 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:11:59.214 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:11:59.214 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. 2022-03-23 02:12:00.232 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 188785 ms 2022-03-23 02:12:00.232 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:00.232 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:12:01.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:01.262 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:12:01.262 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:12:01.262 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. 2022-03-23 02:12:02.282 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 190836 ms 2022-03-23 02:12:02.282 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:02.282 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:12:03.309 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:03.310 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:12:03.310 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:12:03.310 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. 2022-03-23 02:12:04.332 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 192885 ms 2022-03-23 02:12:04.332 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:04.332 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:12:05.355 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:05.357 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:12:05.357 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:12:05.357 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. 2022-03-23 02:12:06.382 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 194935 ms 2022-03-23 02:12:06.382 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:06.382 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:12:07.406 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:07.407 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:12:07.407 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:12:07.407 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. 2022-03-23 02:12:08.431 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 196985 ms 2022-03-23 02:12:08.432 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:08.432 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:12:08.646 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d0531308-423d-4cbd-ad8e-b6b26ab00a40, consumerInstance=onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2022-03-23 02:12:08.647 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 2022-03-23 02:12:08.647 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:08.647 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/d0531308-423d-4cbd-ad8e-b6b26ab00a40/onap-policy-clamp-cl-k8s-ppnt-5d78885df7-rf4dh?timeout=15000 (anonymous) ... 2022-03-23 02:12:09.677 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:09.677 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) 2022-03-23 02:12:09.677 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2022-03-23 02:12:11.469 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:11.470 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2022-03-23 02:12:11.470 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2022-03-23 02:12:11.470 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 92, above threshold 10. 2022-03-23 02:12:12.482 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 201035 ms 2022-03-23 02:12:12.482 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2022-03-23 02:12:12.482 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2022-03-23 02:12:13.517 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2022-03-23 02:12:13.518 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.233.51.39] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.