By type
Policy clamp config file: /opt/app/policy/clamp/etc/mounted/KubernetesParticipantParameters.yaml
overriding logback xml files
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.5.0)
2022-03-22 23:07:01.994 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Starting Application using Java 11.0.11 on dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m with PID 9 (/app/app.jar started by policy in /opt/app/policy/clamp/bin)
2022-03-22 23:07:01.998 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : No active profile set, falling back to default profiles: default
2022-03-22 23:07:06.299 INFO 9 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat]
2022-03-22 23:07:06.299 INFO 9 --- [ main] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.45]
2022-03-22 23:07:06.428 INFO 9 --- [ main] .[/onap/policy/clamp/acm/k8sparticipant] : Initializing Spring embedded WebApplicationContext
2022-03-22 23:07:09.254 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED
2022-03-22 23:07:12.404 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstobjectca [jdk]] and DN [CN=UTN-USERFirst-Object, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:40:36 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.406 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [deutschetelekomrootca2 [jdk]] and DN [CN=Deutsche Telekom Root CA 2, OU=T-TeleSec Trust Center, O=Deutsche Telekom AG, C=DE] is not valid due to [NotAfter: Tue Jul 09 23:59:00 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.407 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [globalsignr2ca [jdk]] and DN [CN=GlobalSign, O=GlobalSign, OU=GlobalSign Root CA - R2] is not valid due to [NotAfter: Wed Dec 15 08:00:00 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.408 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [identrustdstx3 [jdk]] and DN [CN=DST Root CA X3, O=Digital Signature Trust Co.] is not valid due to [NotAfter: Thu Sep 30 14:01:15 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.408 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustexternalca [jdk]] and DN [CN=AddTrust External CA Root, OU=AddTrust External TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:48:38 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.409 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirstclientauthemailca [jdk]] and DN [CN=UTN-USERFirst-Client Authentication and Email, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 17:36:58 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.410 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [verisigntsaca [jdk]] and DN [CN=Thawte Timestamping CA, OU=Thawte Certification, O=Thawte, L=Durbanville, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.410 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [gtecybertrustglobalca [jdk]] and DN [CN=GTE CyberTrust Global Root, OU="GTE CyberTrust Solutions, Inc.", O=GTE Corporation, C=US] is not valid due to [NotAfter: Mon Aug 13 23:59:00 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.411 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [luxtrustglobalrootca [jdk]] and DN [CN=LuxTrust Global Root, O=LuxTrust s.a., C=LU] is not valid due to [NotAfter: Wed Mar 17 09:51:37 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.412 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [soneraclass2ca [jdk]] and DN [CN=Sonera Class2 CA, O=Sonera, C=FI] is not valid due to [NotAfter: Tue Apr 06 07:29:40 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.412 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureglobalebusinessca1 [jdk]] and DN [CN=Equifax Secure Global eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.413 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass3pprimaryca [jdk]] and DN [CN=Class 3P Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.413 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [thawtepremiumserverca [jdk]] and DN [EMAILADDRESS=premium-server@thawte.com, CN=Thawte Premium Server CA, OU=Certification Services Division, O=Thawte Consulting cc, L=Cape Town, ST=Western Cape, C=ZA] is not valid due to [NotAfter: Fri Jan 01 23:59:59 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.414 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureebusinessca1 [jdk]] and DN [CN=Equifax Secure eBusiness CA-1, O=Equifax Secure Inc., C=US] is not valid due to [NotAfter: Mon Jun 22 04:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.414 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [equifaxsecureca [jdk]] and DN [OU=Equifax Secure Certificate Authority, O=Equifax, C=US] is not valid due to [NotAfter: Wed Aug 22 16:41:51 GMT 2018]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.416 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [quovadisrootca [jdk]] and DN [CN=QuoVadis Root Certification Authority, OU=Root Certification Authority, O=QuoVadis Limited, C=BM] is not valid due to [NotAfter: Wed Mar 17 18:33:33 GMT 2021]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.416 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustclass1ca [jdk]] and DN [CN=AddTrust Class 1 CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:38:31 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.417 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [certplusclass2primaryca [jdk]] and DN [CN=Class 2 Primary CA, O=Certplus, C=FR] is not valid due to [NotAfter: Sat Jul 06 23:59:59 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.417 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [keynectisrootca [jdk]] and DN [CN=KEYNECTIS ROOT CA, OU=ROOT, O=KEYNECTIS, C=FR] is not valid due to [NotAfter: Tue May 26 00:00:00 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.418 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [utnuserfirsthardwareca [jdk]] and DN [CN=UTN-USERFirst-Hardware, OU=http://www.usertrust.com, O=The USERTRUST Network, L=Salt Lake City, ST=UT, C=US] is not valid due to [NotAfter: Tue Jul 09 18:19:22 GMT 2019]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:12.418 WARN 9 --- [ main] org.apache.tomcat.util.net.SSLUtilBase : The trusted certificate with alias [addtrustqualifiedca [jdk]] and DN [CN=AddTrust Qualified CA Root, OU=AddTrust TTP Network, O=AddTrust AB, C=SE] is not valid due to [NotAfter: Sat May 30 10:44:50 GMT 2020]. Certificates signed by this trusted certificate WILL be accepted
2022-03-22 23:07:13.012 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting
2022-03-22 23:07:13.012 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic endpoint management
2022-03-22 23:07:13.022 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting
2022-03-22 23:07:13.024 INFO 9 --- [ main] e.e.c.b.i.SingleThreadedDmaapTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED
2022-03-22 23:07:13.030 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:07:13.042 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:07:13.026 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineBusTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=5bfb8528-a384-4f58-bc6d-d5b0d0d23688, alive=false, publisher=null]]: starting
2022-03-22 23:07:13.059 INFO 9 --- [ main] o.o.p.c.e.e.c.b.i.InlineDmaapTopicSink : InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=5bfb8528-a384-4f58-bc6d-d5b0d0d23688, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created
2022-03-22 23:07:13.061 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Publisher ParticipantMessagePublisher
2022-03-22 23:07:13.064 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantStatusReqListener
2022-03-22 23:07:13.072 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantUpdateListener
2022-03-22 23:07:13.073 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopUpdateListener
2022-03-22 23:07:13.073 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantRegisterAckListener
2022-03-22 23:07:13.073 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ControlLoopStateChangeListener
2022-03-22 23:07:13.075 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Listener ParticipantDeregisterAckListener
2022-03-22 23:07:13.076 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager starting Topic Message Dispatcher
2022-03-22 23:07:13.077 INFO 9 --- [ main] o.o.p.c.e.e.comm.bus.internal.TopicBase : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@5df63359
2022-03-22 23:07:13.077 INFO 9 --- [ main] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted
2022-03-22 23:07:13.078 INFO 9 --- [ main] o.o.p.c.utils.services.ServiceManager : service manager started
2022-03-22 23:07:13.092 INFO 9 --- [ main] o.o.p.c.u.services.OrderedServiceImpl : ***** OrderedServiceImpl implementers:
[]
2022-03-22 23:07:13.094 INFO 9 --- [ main] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT]
{"messageType":"PARTICIPANT_REGISTER","messageId":"b5d105c0-651e-4f74-a05f-b4e588726fe4","timestamp":"2022-03-22T23:07:13.078739Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}}
2022-03-22 23:07:13.108 INFO 9 --- [ main] o.o.p.c.c.p.kubernetes.Application : Started Application in 12.592 seconds (JVM running for 13.938)
2022-03-22 23:07:13.158 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 61 ms
2022-03-22 23:07:13.185 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:14.127 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:14.129 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:07:14.129 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:07:14.220 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:14.231 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:14.232 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:15.259 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 2162 ms
2022-03-22 23:07:15.261 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:15.262 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:16.270 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:16.273 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:16.274 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:17.306 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 4210 ms
2022-03-22 23:07:17.307 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:17.309 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:18.316 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:18.319 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:18.320 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:19.357 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 6260 ms
2022-03-22 23:07:19.357 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:19.358 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:20.364 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:20.366 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:20.366 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:21.406 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 8310 ms
2022-03-22 23:07:21.407 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:21.407 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:22.412 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:22.413 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:22.413 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:23.457 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 10360 ms
2022-03-22 23:07:23.457 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:23.458 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:24.464 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:24.466 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:24.467 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:25.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 12410 ms
2022-03-22 23:07:25.507 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:25.508 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:26.540 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:27.457 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:27.458 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:28.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 15410 ms
2022-03-22 23:07:28.507 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:28.507 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:29.133 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:07:29.134 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:07:29.135 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:29.135 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:07:29.516 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:29.519 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:29.519 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:30.156 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:30.156 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:07:30.157 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:07:30.556 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 17460 ms
2022-03-22 23:07:30.557 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:30.557 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:31.564 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:31.565 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:31.566 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:32.606 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 19510 ms
2022-03-22 23:07:32.607 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:32.608 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:33.619 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:33.622 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:33.623 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:34.656 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 21560 ms
2022-03-22 23:07:34.657 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:34.657 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:35.660 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:35.671 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:35.672 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:35.672 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10.
2022-03-22 23:07:36.706 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 23610 ms
2022-03-22 23:07:36.707 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:36.708 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:37.740 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:37.741 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:37.742 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:37.742 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10.
2022-03-22 23:07:38.756 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 25660 ms
2022-03-22 23:07:41.690 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:41.690 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:42.701 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:42.703 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:42.703 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:42.704 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10.
2022-03-22 23:07:43.706 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 30610 ms
2022-03-22 23:07:43.707 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:43.707 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:44.716 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:44.717 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:44.718 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:44.718 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10.
2022-03-22 23:07:45.158 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:07:45.270 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:07:45.270 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:45.271 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:07:45.756 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 32660 ms
2022-03-22 23:07:45.757 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:45.757 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:46.284 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:46.284 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:07:46.285 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:07:46.764 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:46.765 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:46.766 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:46.766 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10.
2022-03-22 23:07:47.806 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 34710 ms
2022-03-22 23:07:50.458 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:50.458 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:51.468 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:51.469 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:51.469 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:51.469 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10.
2022-03-22 23:07:52.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 39410 ms
2022-03-22 23:07:52.507 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:52.507 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:53.516 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:53.517 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:53.518 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:53.518 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10.
2022-03-22 23:07:54.556 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 41460 ms
2022-03-22 23:07:54.975 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:54.976 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:55.980 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:55.981 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:55.982 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:55.982 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10.
2022-03-22 23:07:57.006 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 43910 ms
2022-03-22 23:07:57.007 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:57.007 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:07:58.028 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:07:58.029 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:07:58.029 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:07:58.029 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10.
2022-03-22 23:07:59.056 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 45960 ms
2022-03-22 23:07:59.057 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:07:59.057 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:00.076 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:00.083 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:00.084 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:00.084 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10.
2022-03-22 23:08:01.106 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 48010 ms
2022-03-22 23:08:01.286 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:08:01.477 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:01.478 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:08:01.478 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:01.478 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:01.478 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:08:02.508 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:02.509 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:02.509 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:02.509 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:08:02.509 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:02.509 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:08:02.509 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10.
2022-03-22 23:08:03.556 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 50460 ms
2022-03-22 23:08:03.557 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:03.557 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:04.588 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:04.589 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:04.589 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:04.589 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10.
2022-03-22 23:08:05.606 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 52510 ms
2022-03-22 23:08:05.607 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:05.607 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:06.636 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:06.637 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:06.637 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:06.637 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10.
2022-03-22 23:08:07.656 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 54560 ms
2022-03-22 23:08:07.657 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:07.657 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:08.684 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:08.803 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:08.804 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:08.804 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10.
2022-03-22 23:08:09.806 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 56710 ms
2022-03-22 23:08:09.807 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:09.807 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:10.829 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:10.830 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:10.831 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:10.831 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10.
2022-03-22 23:08:11.856 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 58760 ms
2022-03-22 23:08:11.858 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:11.858 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:12.876 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:13.969 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:13.970 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:13.971 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10.
2022-03-22 23:08:15.006 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 61910 ms
2022-03-22 23:08:15.266 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:15.267 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:16.300 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:16.302 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:16.303 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:16.303 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10.
2022-03-22 23:08:17.306 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 64210 ms
2022-03-22 23:08:17.307 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:17.307 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:17.510 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:08:17.511 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:08:17.512 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:17.512 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:08:18.316 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:18.540 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:19.079 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:08:19.079 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:19.080 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:08:19.080 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:19.080 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10.
2022-03-22 23:08:20.106 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 67010 ms
2022-03-22 23:08:20.107 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:20.107 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:21.132 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:21.133 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:21.134 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:21.134 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10.
2022-03-22 23:08:22.156 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 69060 ms
2022-03-22 23:08:22.157 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:22.157 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:23.181 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:23.183 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:23.183 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:23.184 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10.
2022-03-22 23:08:24.206 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 71110 ms
2022-03-22 23:08:24.207 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:24.207 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:25.228 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:25.230 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:25.230 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:25.230 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10.
2022-03-22 23:08:26.256 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 73160 ms
2022-03-22 23:08:26.312 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:26.312 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:27.340 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:27.365 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:27.366 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:27.367 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10.
2022-03-22 23:08:28.407 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 75310 ms
2022-03-22 23:08:28.408 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:28.409 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:29.421 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:29.426 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:29.427 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:29.428 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10.
2022-03-22 23:08:30.456 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 77360 ms
2022-03-22 23:08:30.458 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:30.458 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:31.472 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:31.501 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:31.502 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:31.502 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10.
2022-03-22 23:08:32.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 79410 ms
2022-03-22 23:08:32.522 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:32.522 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:33.548 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:33.784 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:33.785 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:33.785 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10.
2022-03-22 23:08:34.082 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:08:34.084 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:08:34.085 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:34.085 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:08:34.806 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 81710 ms
2022-03-22 23:08:34.821 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:34.822 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:35.116 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:35.116 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:08:35.116 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:08:35.852 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:35.854 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:35.854 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:35.854 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10.
2022-03-22 23:08:36.856 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 83760 ms
2022-03-22 23:08:36.857 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:36.857 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:37.872 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:37.909 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:37.910 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:37.910 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10.
2022-03-22 23:08:38.956 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 85860 ms
2022-03-22 23:08:38.975 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:38.975 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:39.980 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:39.981 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:39.982 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:39.982 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10.
2022-03-22 23:08:41.006 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 87910 ms
2022-03-22 23:08:41.007 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:41.007 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:42.028 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:42.029 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:42.029 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:42.030 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10.
2022-03-22 23:08:43.056 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 89960 ms
2022-03-22 23:08:43.057 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:43.057 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:44.076 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:44.077 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:44.077 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:44.078 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10.
2022-03-22 23:08:45.106 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 92010 ms
2022-03-22 23:08:45.107 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:45.107 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:46.124 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:46.125 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:46.125 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:46.125 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10.
2022-03-22 23:08:47.158 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 94062 ms
2022-03-22 23:08:47.158 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:47.159 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:48.172 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:48.173 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:48.173 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:48.173 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10.
2022-03-22 23:08:49.207 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 96111 ms
2022-03-22 23:08:49.207 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:49.208 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:50.118 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:08:50.120 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:08:50.120 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:50.120 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:08:50.220 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:50.221 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:50.221 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:50.221 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10.
2022-03-22 23:08:51.148 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:51.148 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:08:51.148 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:08:51.256 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 98160 ms
2022-03-22 23:08:51.257 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:51.257 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:52.268 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:52.268 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:52.269 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:52.269 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10.
2022-03-22 23:08:53.306 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 100210 ms
2022-03-22 23:08:53.307 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:53.307 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:54.316 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:54.316 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:54.317 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:54.317 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10.
2022-03-22 23:08:55.357 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 102261 ms
2022-03-22 23:08:55.357 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:55.358 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:56.364 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:56.364 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:56.365 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:56.365 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10.
2022-03-22 23:08:57.406 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 104310 ms
2022-03-22 23:08:57.408 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:57.408 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:08:58.416 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:08:58.417 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:08:58.417 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:08:58.417 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10.
2022-03-22 23:08:59.456 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 106360 ms
2022-03-22 23:08:59.457 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:08:59.457 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:00.460 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:00.460 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:00.461 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:09:00.461 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10.
2022-03-22 23:09:01.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 108410 ms
2022-03-22 23:09:01.507 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:01.507 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:02.540 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:02.541 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:02.541 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:09:02.541 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10.
2022-03-22 23:09:03.556 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 110460 ms
2022-03-22 23:09:03.557 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:03.557 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:04.588 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:04.589 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:04.589 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:09:04.589 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10.
2022-03-22 23:09:05.606 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 112510 ms
2022-03-22 23:09:05.607 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:05.607 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:06.149 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:09:06.150 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:09:06.150 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:06.150 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:09:06.636 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:06.637 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:06.637 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:09:06.637 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10.
2022-03-22 23:09:07.656 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 1 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 114560 ms
2022-03-22 23:09:07.657 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:07.657 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:08.688 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:08.689 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:08.689 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 1 message to send.
2022-03-22 23:09:08.689 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10.
2022-03-22 23:09:09.390 INFO 9 --- [pool-1-thread-1] network : [OUT|DMAAP|POLICY-CLRUNTIME-PARTICIPANT]
{"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"K8sParticipant0","version":"1.0.0"},"timeStamp":"2022-03-22T23:09:09.346006Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"controlLoopInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"8c186676-a78a-4f06-97ab-7b84a5c13479","timestamp":"2022-03-22T23:09:09.346870Z","participantType":{"name":"org.onap.k8s.controlloop.K8SControlLoopParticipant","version":"2.3.4"},"participantId":{"name":"K8sParticipant0","version":"1.0.0"}}
2022-03-22 23:09:09.706 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 116610 ms
2022-03-22 23:09:09.707 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:09.707 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:10.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:10.733 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:10.733 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:10.733 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10.
2022-03-22 23:09:11.756 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 118660 ms
2022-03-22 23:09:11.757 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:11.757 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:12.780 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:12.781 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:12.781 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:12.781 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10.
2022-03-22 23:09:13.806 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 120710 ms
2022-03-22 23:09:13.807 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:13.807 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:14.828 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:14.828 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:14.829 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:14.829 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10.
2022-03-22 23:09:15.856 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 122760 ms
2022-03-22 23:09:15.857 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:15.857 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:16.876 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:16.877 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:16.877 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:16.877 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10.
2022-03-22 23:09:17.906 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 124810 ms
2022-03-22 23:09:17.907 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:17.907 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:18.925 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:18.927 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:18.927 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:18.927 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10.
2022-03-22 23:09:19.957 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 126860 ms
2022-03-22 23:09:19.958 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:19.959 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:20.973 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:20.976 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:20.977 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:20.977 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10.
2022-03-22 23:09:22.006 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 128910 ms
2022-03-22 23:09:22.007 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:22.008 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:23.020 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:23.021 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:23.021 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:23.021 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10.
2022-03-22 23:09:24.056 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 130960 ms
2022-03-22 23:09:24.057 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:24.057 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:25.072 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:25.072 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:25.073 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:25.073 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10.
2022-03-22 23:09:26.106 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 133010 ms
2022-03-22 23:09:26.107 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:26.107 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:27.116 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:27.118 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:27.118 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:27.118 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10.
2022-03-22 23:09:28.156 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 135060 ms
2022-03-22 23:09:28.157 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:28.157 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:29.164 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:29.165 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:29.165 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:29.165 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10.
2022-03-22 23:09:30.206 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 137110 ms
2022-03-22 23:09:30.207 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:30.207 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:31.212 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:31.213 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:31.343 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:31.344 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10.
2022-03-22 23:09:32.356 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 139260 ms
2022-03-22 23:09:32.357 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:32.357 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:33.388 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:33.388 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:33.389 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:33.389 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10.
2022-03-22 23:09:34.407 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 141310 ms
2022-03-22 23:09:34.407 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:34.408 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:35.436 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:35.437 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:35.437 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:35.437 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10.
2022-03-22 23:09:36.456 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 143360 ms
2022-03-22 23:09:36.457 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:37.548 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:39.172 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:39.173 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:09:39.173 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:09:40.204 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:40.205 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:40.205 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:40.205 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10.
2022-03-22 23:09:41.206 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 148110 ms
2022-03-22 23:09:41.207 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:41.207 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:42.220 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:42.220 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:42.221 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:42.221 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10.
2022-03-22 23:09:43.256 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 150160 ms
2022-03-22 23:09:43.257 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:43.257 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:44.268 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:44.269 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:45.310 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:45.310 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10.
2022-03-22 23:09:46.356 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 153260 ms
2022-03-22 23:09:46.357 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:46.357 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:47.372 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:47.375 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:47.375 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:47.375 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10.
2022-03-22 23:09:48.406 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 155310 ms
2022-03-22 23:09:48.407 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:48.407 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:49.420 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:49.420 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:49.421 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:49.421 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10.
2022-03-22 23:09:50.457 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 157360 ms
2022-03-22 23:09:50.458 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:50.458 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:51.468 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:51.468 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:51.469 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:51.469 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10.
2022-03-22 23:09:52.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 159410 ms
2022-03-22 23:09:52.507 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:52.507 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:53.516 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:53.516 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:53.517 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:53.517 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10.
2022-03-22 23:09:54.174 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:09:54.176 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:09:54.176 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:54.176 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:09:54.556 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 161460 ms
2022-03-22 23:09:54.557 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:54.557 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:55.180 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:55.180 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:09:55.180 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:09:55.564 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:55.564 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:55.565 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:55.565 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10.
2022-03-22 23:09:56.606 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 163510 ms
2022-03-22 23:09:56.607 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:56.607 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:57.612 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:57.612 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:57.613 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:57.613 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10.
2022-03-22 23:09:58.656 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 165560 ms
2022-03-22 23:09:58.657 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:09:58.657 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:09:59.660 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:09:59.661 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:09:59.661 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:09:59.661 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10.
2022-03-22 23:10:00.706 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 167610 ms
2022-03-22 23:10:00.707 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:00.707 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:01.740 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:01.741 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:01.741 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:01.741 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10.
2022-03-22 23:10:02.756 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 169660 ms
2022-03-22 23:10:02.757 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:02.757 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:03.788 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:03.788 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:03.789 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:03.789 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10.
2022-03-22 23:10:04.806 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 171710 ms
2022-03-22 23:10:05.028 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:05.028 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:06.060 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:06.060 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:06.061 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:06.061 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10.
2022-03-22 23:10:07.106 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 174010 ms
2022-03-22 23:10:07.107 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:07.107 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:08.140 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:08.141 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:08.141 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:08.141 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10.
2022-03-22 23:10:09.156 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 176060 ms
2022-03-22 23:10:09.157 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:09.157 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:10.181 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:10:10.182 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:10:10.182 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:10.182 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:10:10.191 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:10.192 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:10.192 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:10.192 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10.
2022-03-22 23:10:11.207 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 178111 ms
2022-03-22 23:10:11.208 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:11.208 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:11.212 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:11.212 ERROR 9 --- [IME-PARTICIPANT] c.b.i.BusConsumer$CambriaConsumerWrapper : CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
2022-03-22 23:10:11.212 INFO 9 --- [IME-PARTICIPANT] .e.c.b.i.BusConsumer$FetchingBusConsumer : CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms
2022-03-22 23:10:12.237 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:12.238 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:12.239 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:12.239 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10.
2022-03-22 23:10:13.256 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 180160 ms
2022-03-22 23:10:13.257 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:13.258 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:14.285 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:14.286 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:14.338 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:14.338 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10.
2022-03-22 23:10:15.360 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 182263 ms
2022-03-22 23:10:15.361 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:15.362 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:16.397 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:16.399 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:16.400 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:16.400 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10.
2022-03-22 23:10:17.407 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 184311 ms
2022-03-22 23:10:17.409 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:17.409 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:18.450 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:18.460 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:18.460 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:18.460 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10.
2022-03-22 23:10:19.461 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 186365 ms
2022-03-22 23:10:19.461 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:19.481 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:20.492 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:20.494 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:20.494 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:20.494 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10.
2022-03-22 23:10:21.506 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 188410 ms
2022-03-22 23:10:21.507 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:21.507 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:22.540 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:22.540 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:22.541 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:22.541 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10.
2022-03-22 23:10:23.559 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 190463 ms
2022-03-22 23:10:23.560 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:23.560 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:24.588 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:24.589 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:24.590 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:24.590 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10.
2022-03-22 23:10:25.606 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 192510 ms
2022-03-22 23:10:25.607 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:25.607 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:26.213 ERROR 9 --- [IME-PARTICIPANT] c.e.e.c.b.i.SingleThreadedBusTopicSource : SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=bde780c5-4396-47b2-88b4-341a3093d91f, consumerInstance=dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-CLRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=true, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-CLRUNTIME-PARTICIPANT, effectiveTopic=POLICY-CLRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) ~[cambriaClient-1.2.1-oss.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:201) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) ~[policy-endpoints-1.10.0.jar!/:na]
at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) ~[policy-endpoints-1.10.0.jar!/:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 17 common frames omitted
2022-03-22 23:10:26.216 INFO 9 --- [IME-PARTICIPANT] c.a.n.c.client.impl.CambriaConsumerImpl : UEB GET /events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000
2022-03-22 23:10:26.216 WARN 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:26.216 INFO 9 --- [IME-PARTICIPANT] com.att.nsa.apiClient.http.HttpClient : GET https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT/bde780c5-4396-47b2-88b4-341a3093d91f/dev-policy-clamp-cl-k8s-ppnt-64bb9cbd5f-ck65m?timeout=15000 (anonymous) ...
2022-03-22 23:10:26.638 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:26.638 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:26.639 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:26.639 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10.
2022-03-22 23:10:27.656 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 194560 ms
2022-03-22 23:10:27.656 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:27.657 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:28.684 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:28.694 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:28.694 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:28.694 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10.
2022-03-22 23:10:29.706 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 196610 ms
2022-03-22 23:10:29.707 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:29.707 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:30.732 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:30.733 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:30.733 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:30.733 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10.
2022-03-22 23:10:31.765 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 198669 ms
2022-03-22 23:10:31.772 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:31.772 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:32.780 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:32.781 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:32.782 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:32.782 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10.
2022-03-22 23:10:33.807 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 200710 ms
2022-03-22 23:10:33.807 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:33.807 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:34.828 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:34.829 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) ~[na:na]
at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.SocksSocketImpl.connect(Unknown Source) ~[na:na]
at java.base/java.net.Socket.connect(Unknown Source) ~[na:na]
at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ~[httpclient-4.5.13.jar!/:4.5.13]
... 20 common frames omitted
2022-03-22 23:10:34.829 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Send failed, 2 message to send.
2022-03-22 23:10:34.830 ERROR 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : PUB_CHRONIC_FAILURE: Send failure count is 92, above threshold 10.
2022-03-22 23:10:35.856 INFO 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : sending 2 msgs to /events/POLICY-CLRUNTIME-PARTICIPANT. Oldest: 202760 ms
2022-03-22 23:10:35.857 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HostSelector : All hosts were blacklisted; reverting to full set of hosts.
2022-03-22 23:10:35.857 INFO 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : POST https://message-router:3905/events/POLICY-CLRUNTIME-PARTICIPANT (anonymous) ...
2022-03-22 23:10:36.876 WARN 9 --- [pool-2-thread-1] com.att.nsa.apiClient.http.HttpClient : Error executing HTTP request. Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused); blacklisting for 2 minutes
2022-03-22 23:10:36.877 WARN 9 --- [pool-2-thread-1] c.a.n.c.c.i.CambriaSimplerBatchPublisher : Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
org.apache.http.conn.HttpHostConnectException: Connect to message-router:3905 [message-router/10.96.156.49] failed: Connection refused (Connection refused)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[httpclient-4.5.13.jar!/:4.5.13]
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[httpclient-4.5.13.jar!/:4.5.13]
at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) ~[saClientLibrary-1.3.0-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) ~[cambriaClient-1.2.1-oss.jar!/:na]
at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) ~[cambriaClient-1.2.1-oss.jar!/:na]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:na]
at java.base/java.lang.Thread.run(Unknown Source) ~[na:na]
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.base/java.net.PlainSocketImpl.socketConnect(Native Method) ~[na: