By type
Policy clamp config file: /opt/app/policy/clamp/etc/mounted/KubernetesParticipantParameters.yaml overriding logback xml files . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.0) 2021-12-18 12:11:06.334 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Starting Application using Java 11.0.11 on dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv with PID 9 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) 2021-12-18 12:11:06.338 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : No active profile set, falling back to default profiles: default 2021-12-18 12:11:09.168 INFO 9 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8083 (https) 2021-12-18 12:11:09.187 INFO 9 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2021-12-18 12:11:09.188 INFO 9 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.45] 2021-12-18 12:11:09.282 INFO 9 --- [ main] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2021-12-18 12:11:09.282 INFO 9 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 2814 ms 2021-12-18 12:11:11.423 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2021-12-18 12:11:13.176 INFO 9 --- [ main] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@2b8bb184, org.springframework.security.web.context.SecurityContextPersistenceFilter@6ed16657, org.springframework.security.web.header.HeaderWriterFilter@10643593, org.springframework.security.web.authentication.logout.LogoutFilter@4af70944, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@67c5ac52, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@113e13f9, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@1bc49bc5, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@472a11ae, org.springframework.security.web.session.SessionManagementFilter@14823f76, org.springframework.security.web.access.ExceptionTranslationFilter@1e43e323, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@4068102e] 2021-12-18 12:11:14.096 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstobjectca [jdk]] and DN [CN=UTN-USERFirst-Object, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:40:36 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.097 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [deutschetelekomrootca2 [jdk]] and DN [CN=Deutsche Telekom Root CA 2, OU=T-TeleSec Trust Center, O=Deutsche Telekom AG, C=DE] is not valid due to [NotAfter: Tue Jul 09 23:59:00 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.097 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [globalsignr2ca [jdk]] and DN [CN=GlobalSign, O=GlobalSign, OU=GlobalSign Root CA - R2] is not valid due to [NotAfter: Wed Dec 15 08:00:00 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.097 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [identrustdstx3 [jdk]] and DN [CN=DST Root CA X3, O=Digital Signature Trust Co.] is not valid due to [NotAfter: Thu Sep 30 14:01:15 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.098 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustexternalca [jdk]] and DN [CN=AddTrust External CA Root, OU=AddTrust External TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:48:38 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.098 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstclientauthemailca [jdk]] and DN [CN=UTN-USERFirst-Client Authentication and Email, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 17:36:58 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.098 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [verisigntsaca [jdk]] and DN [CN=Thawte Timestamping CA, OU=Thawte Certification, O=Thawte, L=Durbanville, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.098 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [gtecybertrustglobalca [jdk]] and DN [CN=GTE CyberTrust Global Root, OU="GTE CyberTrust Solutions, Inc.", O=GTE Corporation, C=US] is not valid due to [NotAfter: Mon Aug 13 23:59:00 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.099 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [luxtrustglobalrootca [jdk]] and DN [CN=LuxTrust Global Root, O=LuxTrust s.a., C=LU] is not valid due to [NotAfter: Wed Mar 17 09:51:37 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.099 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [soneraclass2ca [jdk]] and DN [CN=Sonera Class2 CA, O=Sonera, C=FI] is not valid due to [NotAfter: Tue Apr 06 07:29:40 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.099 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureglobalebusinessca1 [jdk]] and DN [CN=Equifax Secure Global eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.100 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass3pprimaryca [jdk]] and DN [CN=Class 3P Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.100 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [thawtepremiumserverca [jdk]] and DN [EMAILADDRESS=premium-server@thawte.com, CN=Thawte Premium Server CA, OU=Certification Services Division, O=Thawte Consulting cc, L=Cape Town, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.100 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureebusinessca1 [jdk]] and DN [CN=Equifax Secure eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.101 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureca [jdk]] and DN [OU=Equifax Secure Certificate Authority, O=Equifax, C=US] is not valid due to [NotAfter: Wed Aug 22 16:41:51 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.101 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [quovadisrootca [jdk]] and DN [CN=QuoVadis Root Certification Authority, OU=Root Certification Authority, O=QuoVadis Limited, C=BM] is not valid due to [NotAfter: Wed Mar 17 18:33:33 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.101 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustclass1ca [jdk]] and DN [CN=AddTrust Class 1 CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:38:31 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.102 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass2primaryca [jdk]] and DN [CN=Class 2 Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.102 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [keynectisrootca [jdk]] and DN [CN=KEYNECTIS ROOT CA, OU=ROOT, O=KEYNECTIS, C=FR] is not valid due to [NotAfter: Tue May 26 00:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.102 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirsthardwareca [jdk]] and DN [CN=UTN-USERFirst-Hardware, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:19:22 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.102 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustqualifiedca [jdk]] and DN [CN=AddTrust Qualified CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:44:50 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted 2021-12-18 12:11:14.134 INFO 9 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8083 (https) with context path '' 2021-12-18 12:11:14.532 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting 2021-12-18 12:11:14.532 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic endpoint management 2021-12-18 12:11:14.539 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 2021-12-18 12:11:14.541 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 2021-12-18 12:11:14.547 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:11:14.545 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineBusTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=0be45782-0ef3-45a6-a0db-63f0be6acd8b, alive=false, publisher=null]]: starting 2021-12-18 12:11:14.556 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:11:14.561 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineDmaapTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=0be45782-0ef3-45a6-a0db-63f0be6acd8b, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 2021-12-18 12:11:14.561 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Publisher ParticipantMessagePublisher 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantStatusReqListener 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantUpdateListener 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopUpdateListener 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantRegisterAckListener 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopStateChangeListener 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantDeregisterAckListener 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic Message Dispatcher 2021-12-18 12:11:14.562 INFO 9 --- [ main] o.o.p.c.e.e.comm.bus.internal.TopicBase : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@67531e3a 2021-12-18 12:11:14.563 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted 2021-12-18 12:11:14.563 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager started 2021-12-18 12:11:14.712 INFO 9 --- [ main] o.o.p.c.u.services.OrderedServiceImpl : ***** OrderedServiceImpl implementers: [] 2021-12-18 12:11:14.714 INFO 9 --- [ main] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"3b2fd106-134f-4b2b-8107-9575754c11fa","timestamp":"2021-12-18T12:11:14.563500Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2021-12-18 12:11:14.722 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Started Application in 9.486 seconds (JVM running for 10.579) 2021-12-18 12:11:14.724 INFO 9 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state LivenessState changed to CORRECT 2021-12-18 12:11:14.726 INFO 9 --- [ main] o.s.b.a.ApplicationAvailabilityBean : Application availability state ReadinessState changed to ACCEPTING_TRAFFIC 2021-12-18 12:11:14.761 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 45 ms 2021-12-18 12:11:14.766 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:15.788 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:15.788 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:15.789 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:11:15.789 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:11:15.795 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:15.797 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:16.811 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 2095 ms 2021-12-18 12:11:16.811 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:16.812 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:17.829 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:17.831 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:17.831 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:18.861 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 4145 ms 2021-12-18 12:11:18.861 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:18.861 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:19.878 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:19.879 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:19.879 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:20.911 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 6195 ms 2021-12-18 12:11:20.911 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:20.912 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:21.925 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:21.926 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:21.926 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:22.961 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 8245 ms 2021-12-18 12:11:22.961 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:22.961 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:23.973 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:23.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:23.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:25.011 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 10295 ms 2021-12-18 12:11:25.012 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:25.012 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:26.022 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:26.023 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:26.023 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:27.061 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 12345 ms 2021-12-18 12:11:27.063 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:27.064 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:28.070 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:28.071 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:28.072 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:29.111 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 14395 ms 2021-12-18 12:11:29.112 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:29.112 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:30.118 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:30.121 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:30.121 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:30.792 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:11:30.793 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:11:30.793 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:30.794 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:11:31.161 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 16445 ms 2021-12-18 12:11:31.161 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:31.161 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:31.813 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:31.814 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:11:31.814 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:11:32.165 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:32.167 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:32.167 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:33.211 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 18495 ms 2021-12-18 12:11:33.211 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:33.212 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:34.213 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:34.214 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:34.214 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:35.261 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 20545 ms 2021-12-18 12:11:35.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:35.261 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:36.293 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:36.294 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:36.295 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:36.296 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. 2021-12-18 12:11:37.311 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 22595 ms 2021-12-18 12:11:37.311 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:37.311 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:38.341 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:38.342 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:38.343 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:38.343 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. 2021-12-18 12:11:39.361 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 24645 ms 2021-12-18 12:11:39.361 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:39.362 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:40.393 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:40.397 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:40.398 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:40.398 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. 2021-12-18 12:11:41.411 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 26695 ms 2021-12-18 12:11:41.411 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:41.412 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:42.438 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:42.439 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:42.439 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:42.440 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. 2021-12-18 12:11:43.461 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 28745 ms 2021-12-18 12:11:43.461 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:43.461 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:44.485 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:44.486 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:44.487 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:44.487 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. 2021-12-18 12:11:45.511 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 30795 ms 2021-12-18 12:11:45.511 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:45.511 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:46.533 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:46.534 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:46.534 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:46.534 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. 2021-12-18 12:11:46.814 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:11:46.815 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:11:46.815 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:46.815 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:11:47.561 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 32845 ms 2021-12-18 12:11:47.561 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:47.561 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:47.845 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:47.846 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:11:47.846 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:11:50.597 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:50.598 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:50.598 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:50.599 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. 2021-12-18 12:11:51.611 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 36895 ms 2021-12-18 12:11:51.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:51.613 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:52.645 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:52.646 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:52.646 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:52.647 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. 2021-12-18 12:11:53.661 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 38945 ms 2021-12-18 12:11:53.661 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:53.661 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:54.693 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:54.694 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:54.695 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:54.695 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. 2021-12-18 12:11:55.711 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 40995 ms 2021-12-18 12:11:55.711 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:55.711 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:56.746 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:56.746 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:56.747 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:56.747 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. 2021-12-18 12:11:57.761 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 43045 ms 2021-12-18 12:11:57.761 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:57.762 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:11:58.789 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:11:58.790 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:11:58.790 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:11:58.790 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. 2021-12-18 12:11:59.811 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 45095 ms 2021-12-18 12:11:59.811 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:11:59.811 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:00.838 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:00.839 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:00.839 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:00.839 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. 2021-12-18 12:12:01.861 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 47145 ms 2021-12-18 12:12:01.863 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:01.863 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:02.847 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:12:02.847 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:12:02.847 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:02.848 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:12:02.885 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:02.886 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:02.886 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:02.886 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. 2021-12-18 12:12:03.878 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:03.878 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:12:03.878 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:12:03.911 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 49195 ms 2021-12-18 12:12:03.911 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:03.912 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:04.934 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:04.935 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:04.935 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:04.935 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. 2021-12-18 12:12:05.961 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 51245 ms 2021-12-18 12:12:05.961 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:05.961 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:06.985 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:06.986 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:06.986 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:06.986 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. 2021-12-18 12:12:08.012 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 53295 ms 2021-12-18 12:12:08.012 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:08.012 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:09.033 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:09.034 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:09.034 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:09.034 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. 2021-12-18 12:12:10.061 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 55345 ms 2021-12-18 12:12:10.061 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:10.062 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:11.079 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:11.091 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:11.091 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:11.092 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. 2021-12-18 12:12:12.111 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 57395 ms 2021-12-18 12:12:12.113 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:12.113 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:13.126 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:13.127 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:13.127 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:13.127 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. 2021-12-18 12:12:14.161 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 59445 ms 2021-12-18 12:12:14.162 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:14.162 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:15.174 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:15.175 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:15.177 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:15.177 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. 2021-12-18 12:12:16.211 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 61495 ms 2021-12-18 12:12:16.211 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:16.211 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:17.221 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:17.222 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:17.222 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:17.222 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. 2021-12-18 12:12:18.261 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 63545 ms 2021-12-18 12:12:18.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:18.261 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:18.879 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:12:18.881 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:12:18.881 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:18.881 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:12:19.909 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:19.910 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:12:19.910 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:12:21.285 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:21.286 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:21.286 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:21.286 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. 2021-12-18 12:12:22.311 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 67595 ms 2021-12-18 12:12:22.311 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:22.311 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:23.337 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:23.338 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:23.339 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:23.339 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. 2021-12-18 12:12:24.361 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 69645 ms 2021-12-18 12:12:24.361 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:24.361 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:25.381 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:25.382 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:25.382 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:25.382 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. 2021-12-18 12:12:26.411 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 71695 ms 2021-12-18 12:12:26.411 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:26.411 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:27.430 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:27.431 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:27.431 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:27.431 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. 2021-12-18 12:12:28.461 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 73745 ms 2021-12-18 12:12:28.461 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:28.461 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:29.477 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:29.478 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:29.478 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:29.478 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. 2021-12-18 12:12:30.513 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 75797 ms 2021-12-18 12:12:30.513 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:30.514 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:31.525 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:31.526 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:31.526 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:31.526 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. 2021-12-18 12:12:32.561 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 77845 ms 2021-12-18 12:12:32.561 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:32.561 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:33.573 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:33.574 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:33.574 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:33.574 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. 2021-12-18 12:12:34.611 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 79895 ms 2021-12-18 12:12:34.611 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:34.611 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:34.911 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:12:34.911 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:12:34.911 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:34.912 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:12:35.941 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:35.942 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:12:35.942 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:12:37.637 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:37.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:37.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:37.638 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. 2021-12-18 12:12:38.661 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 83945 ms 2021-12-18 12:12:38.661 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:38.661 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:39.686 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:39.686 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:39.686 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:39.686 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. 2021-12-18 12:12:40.711 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 85995 ms 2021-12-18 12:12:40.711 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:40.711 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:41.733 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:41.734 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:41.734 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:41.734 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. 2021-12-18 12:12:42.761 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 88045 ms 2021-12-18 12:12:42.761 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:42.761 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:43.782 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:43.782 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:43.783 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:43.783 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. 2021-12-18 12:12:44.811 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 90095 ms 2021-12-18 12:12:44.811 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:44.811 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:45.833 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:45.834 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:45.834 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:45.834 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. 2021-12-18 12:12:46.861 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 92145 ms 2021-12-18 12:12:46.861 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:46.861 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:47.877 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:47.878 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:47.878 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:47.878 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. 2021-12-18 12:12:48.911 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 94195 ms 2021-12-18 12:12:48.911 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:48.912 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:49.927 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:49.928 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:49.928 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:49.928 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. 2021-12-18 12:12:50.945 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:12:50.946 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:12:50.947 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:50.947 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:12:50.961 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 96245 ms 2021-12-18 12:12:50.962 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:50.962 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:51.974 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:51.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:51.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:51.974 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. 2021-12-18 12:12:53.011 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 98295 ms 2021-12-18 12:12:53.011 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:53.011 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:53.989 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:53.990 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:12:53.990 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:12:56.038 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:56.038 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:56.038 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:56.038 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. 2021-12-18 12:12:57.061 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 102345 ms 2021-12-18 12:12:57.063 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:57.064 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:12:58.086 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:12:58.090 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:12:58.090 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:12:58.090 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. 2021-12-18 12:12:59.111 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 104395 ms 2021-12-18 12:12:59.111 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:12:59.111 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:00.133 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:00.135 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:00.135 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:13:00.135 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. 2021-12-18 12:13:01.161 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 106445 ms 2021-12-18 12:13:01.161 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:01.162 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:02.182 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:02.277 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:02.278 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:13:02.278 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. 2021-12-18 12:13:03.311 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 108595 ms 2021-12-18 12:13:03.311 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:03.316 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:04.331 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:04.334 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:04.335 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:13:04.335 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. 2021-12-18 12:13:05.361 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 110645 ms 2021-12-18 12:13:05.361 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:05.362 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:06.377 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:06.378 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:06.378 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:13:06.378 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. 2021-12-18 12:13:07.413 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 112697 ms 2021-12-18 12:13:07.413 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:07.413 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:08.423 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:08.424 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:08.424 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:13:08.424 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. 2021-12-18 12:13:09.032 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:13:09.034 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:13:09.034 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:09.034 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:13:09.461 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 114745 ms 2021-12-18 12:13:09.461 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:09.461 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:10.054 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:10.054 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:13:10.054 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:13:11.548 INFO 9 --- [pool-1-thread-1] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"K8sParticipant0","version":"1.0.0"},"timeStamp":"2021-12-18T12:13:11.489555Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"controlLoopInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"0a6ccd9b-e658-4225-aa2f-4092f62aff2f","timestamp":"2021-12-18T12:13:11.490140Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}} 2021-12-18 12:13:12.487 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:12.488 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:12.488 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send. 2021-12-18 12:13:12.488 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. 2021-12-18 12:13:13.511 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 118795 ms 2021-12-18 12:13:13.511 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:13.512 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:14.533 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:14.534 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:14.534 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:14.534 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. 2021-12-18 12:13:15.561 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 120845 ms 2021-12-18 12:13:15.561 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:15.561 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:16.582 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:16.583 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:16.583 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:16.584 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. 2021-12-18 12:13:17.613 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 122897 ms 2021-12-18 12:13:17.613 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:17.614 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:18.633 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:18.634 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:18.634 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:18.634 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. 2021-12-18 12:13:19.661 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 124945 ms 2021-12-18 12:13:19.661 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:19.661 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:20.678 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:20.678 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:20.679 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:20.679 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. 2021-12-18 12:13:21.712 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 126996 ms 2021-12-18 12:13:21.712 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:21.712 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:22.725 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:22.726 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:22.727 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:22.727 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. 2021-12-18 12:13:23.761 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 129045 ms 2021-12-18 12:13:23.761 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:23.761 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:24.774 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:24.774 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:24.774 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:24.774 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. 2021-12-18 12:13:25.060 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:13:25.061 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:13:25.061 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:25.061 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:13:25.811 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 131095 ms 2021-12-18 12:13:25.811 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:25.811 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:26.086 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:26.086 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:13:26.086 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:13:26.821 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:26.822 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:26.822 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:26.822 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. 2021-12-18 12:13:27.861 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 133145 ms 2021-12-18 12:13:27.861 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:27.861 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:28.869 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:28.870 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:28.870 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:28.870 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. 2021-12-18 12:13:29.911 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 135195 ms 2021-12-18 12:13:29.911 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:29.911 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:30.918 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:30.918 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:30.918 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:30.918 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. 2021-12-18 12:13:31.961 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 137245 ms 2021-12-18 12:13:31.961 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:31.961 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:32.965 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:32.966 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:32.966 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:32.967 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. 2021-12-18 12:13:34.011 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 139295 ms 2021-12-18 12:13:34.011 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:34.011 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:35.013 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:35.020 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:35.020 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:35.020 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. 2021-12-18 12:13:36.061 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 141345 ms 2021-12-18 12:13:36.061 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:36.061 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:37.094 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:37.094 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:37.094 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:37.094 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. 2021-12-18 12:13:38.111 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 143395 ms 2021-12-18 12:13:38.111 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:38.111 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:39.141 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:39.142 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:39.142 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:39.142 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. 2021-12-18 12:13:40.161 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 145445 ms 2021-12-18 12:13:40.163 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:40.163 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:41.088 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:13:41.090 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:13:41.090 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:41.090 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:13:42.118 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:42.119 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:13:42.119 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:13:43.210 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:43.213 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:43.214 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:43.214 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. 2021-12-18 12:13:44.261 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 149545 ms 2021-12-18 12:13:44.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:44.261 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:45.285 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:45.286 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:45.286 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:45.286 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. 2021-12-18 12:13:46.311 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 151595 ms 2021-12-18 12:13:46.311 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:46.311 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:47.334 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:47.335 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:47.336 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:47.336 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. 2021-12-18 12:13:48.361 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 153645 ms 2021-12-18 12:13:48.361 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:48.361 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:49.382 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:49.382 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:49.383 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:49.384 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. 2021-12-18 12:13:50.411 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 155695 ms 2021-12-18 12:13:50.411 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:50.411 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:51.434 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:51.434 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:51.434 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:51.434 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. 2021-12-18 12:13:52.461 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 157745 ms 2021-12-18 12:13:52.461 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:52.461 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:53.477 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:53.478 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:53.478 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:53.478 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. 2021-12-18 12:13:54.511 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 159795 ms 2021-12-18 12:13:54.511 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:54.511 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:55.525 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:55.526 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:55.526 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:55.526 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. 2021-12-18 12:13:56.561 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 161845 ms 2021-12-18 12:13:56.561 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:56.561 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:13:57.120 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:13:57.120 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:13:57.121 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:13:57.121 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:13:58.149 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:58.150 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) 2021-12-18 12:13:58.150 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 2021-12-18 12:13:59.589 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:13:59.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:13:59.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:13:59.590 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. 2021-12-18 12:14:00.611 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 165895 ms 2021-12-18 12:14:00.611 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:00.611 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:01.637 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:01.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:01.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:01.638 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. 2021-12-18 12:14:02.661 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 167945 ms 2021-12-18 12:14:02.661 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:02.661 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:03.685 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:03.686 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:03.686 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:03.686 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. 2021-12-18 12:14:04.711 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 169995 ms 2021-12-18 12:14:04.711 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:04.711 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:05.733 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:05.734 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:05.734 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:05.734 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. 2021-12-18 12:14:06.761 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 172045 ms 2021-12-18 12:14:06.761 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:06.761 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:07.781 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:07.782 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:07.782 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:07.782 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. 2021-12-18 12:14:08.811 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 174095 ms 2021-12-18 12:14:08.811 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:08.811 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:09.829 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:09.830 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:09.830 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:09.830 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. 2021-12-18 12:14:10.861 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 176145 ms 2021-12-18 12:14:10.861 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:10.861 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:11.877 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:11.878 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:11.878 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:11.878 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. 2021-12-18 12:14:12.911 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 178195 ms 2021-12-18 12:14:12.911 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:12.911 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:13.150 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=875ad49f-30d7-4375-b383-25d927b9e8e1, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.9.1.jar!/:na] at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.9.1.jar!/:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 17 common frames omitted 2021-12-18 12:14:13.151 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 2021-12-18 12:14:13.151 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:13.151 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/875ad49f-30d7-4375-b383-25d927b9e8e1/dev-policy-clamp-cl-k8s-ppnt-7c9d48c444-cvfzv?timeout=15000 (anonymous) ... 2021-12-18 12:14:13.925 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:13.926 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:13.926 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:13.926 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. 2021-12-18 12:14:14.961 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 180245 ms 2021-12-18 12:14:14.961 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:14.962 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:15.974 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:15.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:15.974 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:15.975 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. 2021-12-18 12:14:17.011 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 182295 ms 2021-12-18 12:14:17.011 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:17.011 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:18.025 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:18.026 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:18.026 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:18.026 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. 2021-12-18 12:14:19.061 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 184345 ms 2021-12-18 12:14:19.061 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:19.061 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:20.074 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:20.074 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:20.075 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:20.075 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. 2021-12-18 12:14:21.111 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 186395 ms 2021-12-18 12:14:21.111 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:21.111 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:22.118 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:22.118 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:22.119 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:22.119 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. 2021-12-18 12:14:23.161 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 188445 ms 2021-12-18 12:14:23.161 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:23.161 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:24.165 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:24.166 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:24.166 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:24.166 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. 2021-12-18 12:14:25.211 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 190495 ms 2021-12-18 12:14:25.211 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:25.212 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:26.245 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:26.246 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:26.246 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:26.246 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. 2021-12-18 12:14:27.261 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 192545 ms 2021-12-18 12:14:27.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:27.261 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:28.293 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:28.294 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:28.294 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:28.294 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. 2021-12-18 12:14:29.311 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 194595 ms 2021-12-18 12:14:29.311 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:29.312 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:30.341 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:30.342 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:30.342 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:30.342 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. 2021-12-18 12:14:31.361 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 196645 ms 2021-12-18 12:14:31.361 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:31.361 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:32.389 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:32.390 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:32.390 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:32.390 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. 2021-12-18 12:14:33.413 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 198697 ms 2021-12-18 12:14:33.413 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:33.413 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:34.437 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:34.438 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13] at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na] at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na] at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na] at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na] at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na] at java.base/java.net.Socket.connect(Unknown Source) ~[na:na] at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13] at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13] ... 20 common frames omitted 2021-12-18 12:14:34.438 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send. 2021-12-18 12:14:34.438 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. 2021-12-18 12:14:35.461 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 200745 ms 2021-12-18 12:14:35.461 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts. 2021-12-18 12:14:35.461 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ... 2021-12-18 12:14:36.485 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.152.164] failed: Connection refused (Connection refused); blacklisting for 2 minutes 2021-12-18 12:14:36.486 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connec