Policy clamp policy participant config file: /opt/app/policy/clamp/etc/mounted/PolicyParticipantParameters.yaml overriding logback xml file . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.14) [2023-01-14T23:05:40.338+00:00|INFO|PolicyParticipantApplication|main] Starting PolicyParticipantApplication using Java 11.0.11 on onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p with PID 7 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) [2023-01-14T23:05:40.343+00:00|INFO|PolicyParticipantApplication|main] No active profile set, falling back to 1 default profile: "default" [2023-01-14T23:05:43.755+00:00|INFO|TomcatWebServer|main] Tomcat initialized with port(s): 8085 (http) [2023-01-14T23:05:43.773+00:00|INFO|Http11NioProtocol|main] Initializing ProtocolHandler ["http-nio-8085"] [2023-01-14T23:05:43.774+00:00|INFO|StandardService|main] Starting service [Tomcat] [2023-01-14T23:05:43.774+00:00|INFO|StandardEngine|main] Starting Servlet engine: [Apache Tomcat/9.0.62] [2023-01-14T23:05:43.987+00:00|INFO|[/onap/policyparticipant]|main] Initializing Spring embedded WebApplicationContext [2023-01-14T23:05:43.988+00:00|INFO|ServletWebServerApplicationContext|main] Root WebApplicationContext: initialization completed in 3553 ms [2023-01-14T23:05:44.829+00:00|INFO|Version|main] HV000001: Hibernate Validator 6.2.3.Final [2023-01-14T23:05:46.615+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED [2023-01-14T23:05:47.224+00:00|INFO|EndpointLinksResolver|main] Exposing 3 endpoint(s) beneath base path '/actuator' [2023-01-14T23:05:48.564+00:00|INFO|DefaultSecurityFilterChain|main] Will not secure any request [2023-01-14T23:05:48.847+00:00|INFO|Http11NioProtocol|main] Starting ProtocolHandler ["http-nio-8085"] [2023-01-14T23:05:48.886+00:00|INFO|TomcatWebServer|main] Tomcat started on port(s): 8085 (http) with context path '/onap/policyparticipant' [2023-01-14T23:05:49.331+00:00|INFO|ServiceManager|main] service manager starting [2023-01-14T23:05:49.332+00:00|INFO|ServiceManager|main] service manager starting Topic endpoint management [2023-01-14T23:05:49.341+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting [2023-01-14T23:05:49.343+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED [2023-01-14T23:05:49.346+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:05:49.350+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:05:49.344+00:00|INFO|InlineBusTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=14ab612c-7293-449f-aa48-eeb428305f9a, alive=false, publisher=null]]: starting [2023-01-14T23:05:49.362+00:00|INFO|InlineDmaapTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=14ab612c-7293-449f-aa48-eeb428305f9a, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created [2023-01-14T23:05:49.362+00:00|INFO|ServiceManager|main] service manager starting Publisher ParticipantMessagePublisher [2023-01-14T23:05:49.363+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantRegisterAckListener [2023-01-14T23:05:49.363+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantStatusReqListener [2023-01-14T23:05:49.364+00:00|INFO|ServiceManager|main] service manager starting Listener AutomationCompositionStateChangeListener [2023-01-14T23:05:49.364+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantDeregisterAckListener [2023-01-14T23:05:49.364+00:00|INFO|ServiceManager|main] service manager starting Listener AutomationCompositionUpdateListener [2023-01-14T23:05:49.364+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantUpdateListener [2023-01-14T23:05:49.365+00:00|INFO|ServiceManager|main] service manager starting Topic Message Dispatcher [2023-01-14T23:05:49.365+00:00|INFO|TopicBase|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@250a9031 [2023-01-14T23:05:49.365+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted [2023-01-14T23:05:49.366+00:00|INFO|ServiceManager|main] service manager started [2023-01-14T23:05:49.377+00:00|INFO|OrderedServiceImpl|main] ***** OrderedServiceImpl implementers: [] [2023-01-14T23:05:49.379+00:00|INFO|network|main] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"59751127-5e89-4376-8ae4-d569589ea872","timestamp":"2023-01-14T23:05:49.366618Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-14T23:05:49.390+00:00|INFO|PolicyParticipantApplication|main] Started PolicyParticipantApplication in 10.37 seconds (JVM running for 11.71) [2023-01-14T23:05:49.462+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 82 ms [2023-01-14T23:05:49.469+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:49.475+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:49.476+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:49.477+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:49.478+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:05:49.481+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:49.481+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:50.511+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 1131 ms [2023-01-14T23:05:50.511+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:50.512+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:50.522+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:50.523+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:50.523+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:51.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 2180 ms [2023-01-14T23:05:51.560+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:51.561+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:51.563+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:51.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:51.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:52.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 3230 ms [2023-01-14T23:05:52.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:52.611+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:52.613+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:52.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:52.618+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:53.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 4280 ms [2023-01-14T23:05:53.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:53.660+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:53.672+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:53.672+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:53.673+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:54.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 5330 ms [2023-01-14T23:05:54.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:54.710+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:54.717+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:54.719+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:54.719+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:55.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 6380 ms [2023-01-14T23:05:55.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:55.760+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:55.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:55.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:55.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:56.812+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 7432 ms [2023-01-14T23:05:56.812+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:56.812+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:56.868+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:56.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:56.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:57.912+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 8532 ms [2023-01-14T23:05:57.912+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:57.912+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:57.915+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:57.915+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:57.915+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:05:58.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 9580 ms [2023-01-14T23:05:58.961+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:05:58.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:05:58.965+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:05:58.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:05:58.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:00.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 10630 ms [2023-01-14T23:06:00.011+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:00.011+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:00.014+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:00.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:00.015+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:00.015+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. [2023-01-14T23:06:01.063+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 11683 ms [2023-01-14T23:06:01.063+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:01.064+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:01.067+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:01.069+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:01.069+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:01.069+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. [2023-01-14T23:06:02.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 12730 ms [2023-01-14T23:06:02.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:02.110+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:02.113+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:02.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:02.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:02.114+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. [2023-01-14T23:06:03.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 13780 ms [2023-01-14T23:06:03.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:03.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:03.164+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:03.164+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:03.164+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:03.164+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. [2023-01-14T23:06:04.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 14830 ms [2023-01-14T23:06:04.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:04.211+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:04.216+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:04.216+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:04.216+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:04.216+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. [2023-01-14T23:06:04.481+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:06:04.482+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:06:04.482+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:06:04.495+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:04.495+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:04.495+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:06:05.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 15880 ms [2023-01-14T23:06:05.261+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:05.261+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:05.264+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:05.265+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:05.265+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:05.266+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. [2023-01-14T23:06:06.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 16930 ms [2023-01-14T23:06:06.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:06.311+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:06.315+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:06.317+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:06.317+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:06.317+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. [2023-01-14T23:06:07.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 17980 ms [2023-01-14T23:06:07.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:07.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:07.365+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:07.366+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:07.366+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:07.366+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. [2023-01-14T23:06:08.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 19030 ms [2023-01-14T23:06:08.411+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:08.411+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:08.417+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:08.418+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:08.418+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:08.418+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. [2023-01-14T23:06:09.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 20080 ms [2023-01-14T23:06:09.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:09.461+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:09.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:09.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:09.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:09.465+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. [2023-01-14T23:06:10.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 21130 ms [2023-01-14T23:06:10.511+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:10.511+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:10.514+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:10.514+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:10.515+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:10.515+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. [2023-01-14T23:06:11.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 22180 ms [2023-01-14T23:06:11.561+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:11.561+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:11.563+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:11.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:11.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:11.565+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. [2023-01-14T23:06:12.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 23230 ms [2023-01-14T23:06:12.613+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:12.614+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:12.620+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:12.621+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:12.621+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:12.622+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. [2023-01-14T23:06:13.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 24280 ms [2023-01-14T23:06:13.661+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:13.662+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:13.673+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:13.673+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:13.680+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:13.680+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. [2023-01-14T23:06:14.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 25330 ms [2023-01-14T23:06:14.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:14.711+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:14.717+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:14.718+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:14.718+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:14.718+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. [2023-01-14T23:06:15.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 26380 ms [2023-01-14T23:06:15.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:15.760+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:15.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:15.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:15.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:15.764+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. [2023-01-14T23:06:16.764+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 27384 ms [2023-01-14T23:06:16.764+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:16.765+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:16.772+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:16.773+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:16.773+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:16.773+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. [2023-01-14T23:06:17.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 28430 ms [2023-01-14T23:06:17.810+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:17.810+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:17.813+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:17.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:17.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:17.813+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. [2023-01-14T23:06:18.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 29480 ms [2023-01-14T23:06:18.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:18.861+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:18.863+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:18.864+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:18.864+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:18.864+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. [2023-01-14T23:06:19.495+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:06:19.496+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:06:19.496+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:06:19.499+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:19.499+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:19.500+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:06:19.912+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 30532 ms [2023-01-14T23:06:19.912+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:19.912+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:19.929+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:19.929+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:19.929+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:19.929+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. [2023-01-14T23:06:20.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 31580 ms [2023-01-14T23:06:20.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:20.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:20.964+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:20.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:20.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:20.965+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. [2023-01-14T23:06:22.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 32630 ms [2023-01-14T23:06:22.011+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:22.011+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:22.013+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:22.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:22.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:22.014+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. [2023-01-14T23:06:23.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 33680 ms [2023-01-14T23:06:23.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:23.060+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:23.066+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:23.066+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:23.066+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:23.066+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. [2023-01-14T23:06:24.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 34730 ms [2023-01-14T23:06:24.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:24.111+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:24.114+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:24.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:24.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:24.115+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. [2023-01-14T23:06:25.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 35780 ms [2023-01-14T23:06:25.161+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:25.162+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:25.166+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:25.166+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:25.167+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:25.167+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. [2023-01-14T23:06:26.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 36830 ms [2023-01-14T23:06:26.211+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:26.211+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:26.217+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:26.217+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:26.218+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:26.218+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. [2023-01-14T23:06:27.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 37880 ms [2023-01-14T23:06:27.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:27.261+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:27.265+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:27.266+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:27.266+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:27.266+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. [2023-01-14T23:06:28.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 38930 ms [2023-01-14T23:06:28.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:28.310+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:28.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:28.313+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:28.313+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:28.313+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. [2023-01-14T23:06:29.361+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 39981 ms [2023-01-14T23:06:29.372+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:29.372+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:29.375+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:29.392+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:29.393+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:29.393+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. [2023-01-14T23:06:30.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 41030 ms [2023-01-14T23:06:30.411+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:30.411+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:30.427+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:30.428+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:30.428+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:30.428+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. [2023-01-14T23:06:31.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 42080 ms [2023-01-14T23:06:31.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:31.460+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:31.468+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:31.469+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:31.469+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:31.469+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. [2023-01-14T23:06:32.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 43130 ms [2023-01-14T23:06:32.510+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:32.510+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:32.513+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:32.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:32.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:32.513+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. [2023-01-14T23:06:33.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 44180 ms [2023-01-14T23:06:33.560+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:33.560+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:33.564+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:33.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:33.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:33.564+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. [2023-01-14T23:06:34.501+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:06:34.501+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:06:34.502+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:06:34.507+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:34.507+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:34.507+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:06:34.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 45230 ms [2023-01-14T23:06:34.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:34.610+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:34.613+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:34.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:34.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:34.614+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. [2023-01-14T23:06:35.616+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 46236 ms [2023-01-14T23:06:35.616+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:35.617+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:35.635+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:35.635+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:35.635+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:35.635+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. [2023-01-14T23:06:36.663+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 47283 ms [2023-01-14T23:06:36.663+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:36.663+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:36.669+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:36.669+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:36.669+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:36.669+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. [2023-01-14T23:06:37.712+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 48332 ms [2023-01-14T23:06:37.712+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:37.712+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:37.717+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:37.717+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:37.717+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:37.717+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. [2023-01-14T23:06:38.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 49380 ms [2023-01-14T23:06:38.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:38.760+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:38.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:38.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:38.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:38.763+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. [2023-01-14T23:06:39.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 50430 ms [2023-01-14T23:06:39.810+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:39.810+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:39.813+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:39.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:39.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:39.813+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. [2023-01-14T23:06:40.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 51480 ms [2023-01-14T23:06:40.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:40.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:40.863+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:40.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:40.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:40.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. [2023-01-14T23:06:41.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 52530 ms [2023-01-14T23:06:41.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:41.910+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:41.914+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:41.915+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:41.916+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:41.916+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. [2023-01-14T23:06:42.961+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 53581 ms [2023-01-14T23:06:42.961+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:42.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:42.965+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:42.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:42.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:42.966+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. [2023-01-14T23:06:44.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 54630 ms [2023-01-14T23:06:44.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:44.011+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:44.013+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:44.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:44.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:44.014+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. [2023-01-14T23:06:45.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 55680 ms [2023-01-14T23:06:45.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:45.061+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:45.063+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:45.063+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:45.063+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:45.063+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. [2023-01-14T23:06:46.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 56730 ms [2023-01-14T23:06:46.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:46.110+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:46.113+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:46.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:46.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:46.113+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. [2023-01-14T23:06:47.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 57780 ms [2023-01-14T23:06:47.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:47.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:47.163+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:47.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:47.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:47.163+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. [2023-01-14T23:06:48.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 58830 ms [2023-01-14T23:06:48.211+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:48.211+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:48.214+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:48.214+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:48.214+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:48.215+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. [2023-01-14T23:06:49.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 59880 ms [2023-01-14T23:06:49.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:49.261+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:49.263+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:49.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:49.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:49.264+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. [2023-01-14T23:06:49.508+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:06:49.508+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:06:49.509+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:06:49.512+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:49.512+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:49.512+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:06:50.316+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 60936 ms [2023-01-14T23:06:50.316+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:50.316+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:50.335+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:50.335+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:50.336+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:50.337+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. [2023-01-14T23:06:51.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 61980 ms [2023-01-14T23:06:51.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:51.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:51.362+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:51.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:51.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:51.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. [2023-01-14T23:06:52.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 63030 ms [2023-01-14T23:06:52.411+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:52.411+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:52.413+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:52.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:52.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:52.415+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. [2023-01-14T23:06:53.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 64080 ms [2023-01-14T23:06:53.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:53.461+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:53.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:53.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:53.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:53.464+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. [2023-01-14T23:06:54.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 65130 ms [2023-01-14T23:06:54.510+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:54.510+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:54.512+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:54.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:54.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:54.513+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. [2023-01-14T23:06:55.564+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 66184 ms [2023-01-14T23:06:55.564+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:55.564+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:55.572+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:55.572+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:55.572+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:55.572+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. [2023-01-14T23:06:56.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 67230 ms [2023-01-14T23:06:56.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:56.610+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:56.614+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:56.615+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:56.615+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:56.615+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. [2023-01-14T23:06:57.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 68280 ms [2023-01-14T23:06:57.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:57.661+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:57.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:57.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:57.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:57.664+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. [2023-01-14T23:06:58.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 69330 ms [2023-01-14T23:06:58.711+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:58.711+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:58.714+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:58.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:58.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:58.715+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. [2023-01-14T23:06:59.761+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 70381 ms [2023-01-14T23:06:59.761+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:06:59.762+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:06:59.764+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:06:59.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:06:59.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:06:59.765+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. [2023-01-14T23:07:00.817+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 71437 ms [2023-01-14T23:07:00.817+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:00.818+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:00.821+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:00.822+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:00.822+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:00.822+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. [2023-01-14T23:07:01.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 72480 ms [2023-01-14T23:07:01.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:01.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:01.862+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:01.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:01.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:01.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. [2023-01-14T23:07:02.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 73530 ms [2023-01-14T23:07:02.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:02.910+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:02.913+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:02.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:02.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:02.913+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. [2023-01-14T23:07:03.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 74580 ms [2023-01-14T23:07:03.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:03.960+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:03.962+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:03.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:03.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:03.963+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. [2023-01-14T23:07:04.512+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:07:04.513+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:07:04.513+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:07:04.518+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:04.518+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:04.518+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:07:05.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 75630 ms [2023-01-14T23:07:05.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:05.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:05.012+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:05.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:05.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:05.013+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. [2023-01-14T23:07:06.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 76680 ms [2023-01-14T23:07:06.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:06.060+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:06.065+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:06.066+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:06.066+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:06.066+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. [2023-01-14T23:07:07.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 77730 ms [2023-01-14T23:07:07.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:07.111+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:07.114+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:07.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:07.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:07.114+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. [2023-01-14T23:07:08.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 78780 ms [2023-01-14T23:07:08.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:08.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:08.163+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:08.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:08.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:08.163+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. [2023-01-14T23:07:09.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 79830 ms [2023-01-14T23:07:09.211+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:09.211+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:09.215+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:09.215+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:09.216+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:09.216+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. [2023-01-14T23:07:10.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 80880 ms [2023-01-14T23:07:10.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:10.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:10.263+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:10.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:10.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:10.264+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. [2023-01-14T23:07:11.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 81930 ms [2023-01-14T23:07:11.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:11.310+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:11.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:11.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:11.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:11.314+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. [2023-01-14T23:07:12.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 82980 ms [2023-01-14T23:07:12.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:12.361+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:12.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:12.364+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:12.364+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:12.364+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. [2023-01-14T23:07:13.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 84030 ms [2023-01-14T23:07:13.411+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:13.411+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:13.414+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:13.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:13.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:13.414+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. [2023-01-14T23:07:14.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 85080 ms [2023-01-14T23:07:14.461+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:14.461+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:14.464+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:14.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:14.465+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:14.465+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. [2023-01-14T23:07:15.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 86130 ms [2023-01-14T23:07:15.510+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:15.510+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:15.513+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:15.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:15.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:15.513+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. [2023-01-14T23:07:16.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 87180 ms [2023-01-14T23:07:16.561+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:16.561+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:16.563+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:16.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:16.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:16.564+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. [2023-01-14T23:07:17.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 88230 ms [2023-01-14T23:07:17.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:17.610+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:17.613+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:17.613+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:17.613+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:17.614+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. [2023-01-14T23:07:18.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 89280 ms [2023-01-14T23:07:18.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:18.661+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:18.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:18.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:18.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:18.664+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. [2023-01-14T23:07:19.518+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:07:19.519+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:07:19.519+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:07:19.522+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:19.523+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:19.523+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:07:19.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 90330 ms [2023-01-14T23:07:19.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:19.711+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:19.713+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:19.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:19.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:19.713+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. [2023-01-14T23:07:20.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 91380 ms [2023-01-14T23:07:20.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:20.760+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:20.765+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:20.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:20.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:20.765+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. [2023-01-14T23:07:21.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 92430 ms [2023-01-14T23:07:21.810+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:21.811+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:21.814+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:21.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:21.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:21.814+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. [2023-01-14T23:07:22.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 93480 ms [2023-01-14T23:07:22.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:22.861+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:22.863+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:22.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:22.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:22.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. [2023-01-14T23:07:23.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 94530 ms [2023-01-14T23:07:23.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:23.911+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:23.913+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:23.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:23.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:23.913+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. [2023-01-14T23:07:24.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 95580 ms [2023-01-14T23:07:24.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:24.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:24.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:24.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:24.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:24.964+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 92, above threshold 10. [2023-01-14T23:07:26.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 96630 ms [2023-01-14T23:07:26.011+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:26.012+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:26.015+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:26.015+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:26.015+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:26.016+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 93, above threshold 10. [2023-01-14T23:07:27.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 97680 ms [2023-01-14T23:07:27.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:27.061+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:27.064+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:27.064+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:27.064+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:27.064+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 94, above threshold 10. [2023-01-14T23:07:28.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 98730 ms [2023-01-14T23:07:28.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:28.111+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:28.114+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:28.115+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:28.115+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:28.115+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 95, above threshold 10. [2023-01-14T23:07:29.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 99780 ms [2023-01-14T23:07:29.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:29.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:29.162+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:29.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:29.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:29.163+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 96, above threshold 10. [2023-01-14T23:07:30.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 100830 ms [2023-01-14T23:07:30.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:30.210+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:30.213+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:30.214+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:30.214+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:30.214+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 97, above threshold 10. [2023-01-14T23:07:31.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 101880 ms [2023-01-14T23:07:31.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:31.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:31.263+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:31.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:31.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:31.263+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 98, above threshold 10. [2023-01-14T23:07:32.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 102930 ms [2023-01-14T23:07:32.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:32.311+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:32.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:32.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:32.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:32.314+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 99, above threshold 10. [2023-01-14T23:07:33.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 103980 ms [2023-01-14T23:07:33.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:33.361+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:33.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:33.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:33.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:33.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 100, above threshold 10. [2023-01-14T23:07:34.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 105030 ms [2023-01-14T23:07:34.410+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:34.411+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:34.413+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:34.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:34.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:34.414+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 101, above threshold 10. [2023-01-14T23:07:34.524+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:07:34.525+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:07:34.525+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:07:34.529+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:34.529+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:34.529+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:07:35.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 106080 ms [2023-01-14T23:07:35.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:35.461+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:35.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:35.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:35.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:35.463+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 102, above threshold 10. [2023-01-14T23:07:36.512+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 107132 ms [2023-01-14T23:07:36.512+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:36.513+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:36.515+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:36.515+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:36.515+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:36.515+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 103, above threshold 10. [2023-01-14T23:07:37.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 108180 ms [2023-01-14T23:07:37.561+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:37.561+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:37.564+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:37.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:37.565+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:37.565+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 104, above threshold 10. [2023-01-14T23:07:38.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 109230 ms [2023-01-14T23:07:38.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:38.611+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:38.613+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:38.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:38.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:38.614+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 105, above threshold 10. [2023-01-14T23:07:39.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 110280 ms [2023-01-14T23:07:39.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:39.660+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:39.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:39.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:39.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:39.663+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 106, above threshold 10. [2023-01-14T23:07:40.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 111330 ms [2023-01-14T23:07:40.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:40.710+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:40.713+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:40.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:40.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:40.713+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 107, above threshold 10. [2023-01-14T23:07:41.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 112380 ms [2023-01-14T23:07:41.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:41.760+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:41.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:41.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:41.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:41.763+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 108, above threshold 10. [2023-01-14T23:07:42.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 113430 ms [2023-01-14T23:07:42.810+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:42.810+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:42.813+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:42.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:42.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:42.813+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 109, above threshold 10. [2023-01-14T23:07:43.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 114480 ms [2023-01-14T23:07:43.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:43.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:43.863+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:43.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:43.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:43.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 110, above threshold 10. [2023-01-14T23:07:44.911+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 115531 ms [2023-01-14T23:07:44.912+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:44.912+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:44.915+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:44.915+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:44.915+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:44.915+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 111, above threshold 10. [2023-01-14T23:07:45.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 116580 ms [2023-01-14T23:07:45.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:45.960+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:45.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:45.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:45.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-14T23:07:45.963+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 112, above threshold 10. [2023-01-14T23:07:46.069+00:00|INFO|network|pool-2-thread-1] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"},"timeStamp":"2023-01-14T23:07:46.028372Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"automationCompositionInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"5921b7ec-7aa3-4ac7-a3cf-542a9cfc00c5","timestamp":"2023-01-14T23:07:46.029254Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-14T23:07:47.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 117630 ms [2023-01-14T23:07:47.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:47.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:47.013+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:47.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:47.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:47.013+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 113, above threshold 10. [2023-01-14T23:07:48.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 118680 ms [2023-01-14T23:07:48.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:48.060+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:48.062+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:48.063+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:48.063+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:48.063+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 114, above threshold 10. [2023-01-14T23:07:49.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 119730 ms [2023-01-14T23:07:49.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:49.111+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:49.113+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:49.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:49.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:49.114+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 115, above threshold 10. [2023-01-14T23:07:49.530+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:07:49.530+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:07:49.531+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:07:49.535+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:49.535+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:49.535+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:07:50.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 120780 ms [2023-01-14T23:07:50.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:50.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:50.162+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:50.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:50.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:50.163+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 116, above threshold 10. [2023-01-14T23:07:51.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 121830 ms [2023-01-14T23:07:51.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:51.211+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:51.215+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:51.215+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:51.215+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:51.216+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 117, above threshold 10. [2023-01-14T23:07:52.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 122880 ms [2023-01-14T23:07:52.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:52.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:52.263+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:52.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:52.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:52.264+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 118, above threshold 10. [2023-01-14T23:07:53.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 123930 ms [2023-01-14T23:07:53.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:53.311+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:53.314+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:53.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:53.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:53.314+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 119, above threshold 10. [2023-01-14T23:07:54.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 124980 ms [2023-01-14T23:07:54.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:54.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:54.362+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:54.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:54.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:54.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 120, above threshold 10. [2023-01-14T23:07:55.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 126030 ms [2023-01-14T23:07:55.410+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:55.410+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:55.413+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:55.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:55.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:55.413+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 121, above threshold 10. [2023-01-14T23:07:56.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 127080 ms [2023-01-14T23:07:56.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:56.461+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:56.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:56.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:56.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:56.464+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 122, above threshold 10. [2023-01-14T23:07:57.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 128130 ms [2023-01-14T23:07:57.511+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:57.511+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:57.514+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:57.514+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:57.515+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:57.515+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 123, above threshold 10. [2023-01-14T23:07:58.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 129180 ms [2023-01-14T23:07:58.561+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:58.561+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:58.564+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:58.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:58.565+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:58.565+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 124, above threshold 10. [2023-01-14T23:07:59.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 130230 ms [2023-01-14T23:07:59.611+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:07:59.611+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:07:59.614+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:07:59.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:07:59.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:07:59.615+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 125, above threshold 10. [2023-01-14T23:08:00.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 131280 ms [2023-01-14T23:08:00.661+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:00.661+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:00.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:00.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:00.665+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:00.666+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 126, above threshold 10. [2023-01-14T23:08:01.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 132330 ms [2023-01-14T23:08:01.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:01.710+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:01.712+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:01.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:01.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:01.713+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 127, above threshold 10. [2023-01-14T23:08:02.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 133380 ms [2023-01-14T23:08:02.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:02.761+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:02.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:02.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:02.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:02.764+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 128, above threshold 10. [2023-01-14T23:08:03.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 134430 ms [2023-01-14T23:08:03.810+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:03.810+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:03.812+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:03.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:03.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:03.813+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 129, above threshold 10. [2023-01-14T23:08:04.536+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:08:04.536+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:08:04.537+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:08:04.540+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:04.540+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:04.540+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:08:04.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 135480 ms [2023-01-14T23:08:04.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:04.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:04.863+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:04.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:04.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:04.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 130, above threshold 10. [2023-01-14T23:08:05.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 136530 ms [2023-01-14T23:08:05.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:05.910+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:05.912+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:05.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:05.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:05.913+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 131, above threshold 10. [2023-01-14T23:08:06.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 137580 ms [2023-01-14T23:08:06.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:06.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:06.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:06.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:06.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:06.963+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 132, above threshold 10. [2023-01-14T23:08:08.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 138630 ms [2023-01-14T23:08:08.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:08.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:08.013+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:08.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:08.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:08.013+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 133, above threshold 10. [2023-01-14T23:08:09.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 139680 ms [2023-01-14T23:08:09.061+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:09.061+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:09.065+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:09.065+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:09.065+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:09.065+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 134, above threshold 10. [2023-01-14T23:08:10.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 140730 ms [2023-01-14T23:08:10.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:10.111+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:10.113+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:10.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:10.114+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:10.114+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 135, above threshold 10. [2023-01-14T23:08:11.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 141780 ms [2023-01-14T23:08:11.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:11.161+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:11.163+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:11.164+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:11.164+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:11.164+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 136, above threshold 10. [2023-01-14T23:08:12.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 142830 ms [2023-01-14T23:08:12.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:12.210+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:12.214+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:12.215+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:12.215+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:12.215+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 137, above threshold 10. [2023-01-14T23:08:13.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 143880 ms [2023-01-14T23:08:13.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:13.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:13.264+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:13.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:13.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:13.264+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 138, above threshold 10. [2023-01-14T23:08:14.264+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 144884 ms [2023-01-14T23:08:14.264+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:14.264+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:14.266+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:14.267+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:14.267+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:14.267+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 139, above threshold 10. [2023-01-14T23:08:15.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 145930 ms [2023-01-14T23:08:15.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:15.311+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:15.314+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:15.315+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:15.316+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:15.316+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 140, above threshold 10. [2023-01-14T23:08:16.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 146980 ms [2023-01-14T23:08:16.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:16.361+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:16.365+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:16.366+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:16.366+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:16.366+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 141, above threshold 10. [2023-01-14T23:08:17.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 148030 ms [2023-01-14T23:08:17.410+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:17.411+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:17.414+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:17.415+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:17.416+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:17.416+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 142, above threshold 10. [2023-01-14T23:08:18.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 149080 ms [2023-01-14T23:08:18.461+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:18.461+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:18.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:18.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:18.465+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:18.465+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 143, above threshold 10. [2023-01-14T23:08:19.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 150130 ms [2023-01-14T23:08:19.511+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:19.511+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:19.514+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:19.515+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:19.515+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:19.515+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 144, above threshold 10. [2023-01-14T23:08:19.540+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:08:19.541+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:08:19.541+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:08:19.544+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:19.544+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:19.544+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:08:20.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 151180 ms [2023-01-14T23:08:20.560+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:20.560+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:20.563+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:20.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:20.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:20.564+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 145, above threshold 10. [2023-01-14T23:08:21.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 152230 ms [2023-01-14T23:08:21.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:21.611+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:21.615+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:21.616+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:21.616+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:21.616+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 146, above threshold 10. [2023-01-14T23:08:22.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 153280 ms [2023-01-14T23:08:22.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:22.660+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:22.662+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:22.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:22.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:22.663+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 147, above threshold 10. [2023-01-14T23:08:23.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 154330 ms [2023-01-14T23:08:23.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:23.710+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:23.713+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:23.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:23.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:23.713+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 148, above threshold 10. [2023-01-14T23:08:24.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 155380 ms [2023-01-14T23:08:24.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:24.760+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:24.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:24.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:24.763+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:24.763+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 149, above threshold 10. [2023-01-14T23:08:25.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 156430 ms [2023-01-14T23:08:25.810+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:25.810+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:25.813+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:25.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:25.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:25.814+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 150, above threshold 10. [2023-01-14T23:08:26.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 157480 ms [2023-01-14T23:08:26.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:26.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:26.862+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:26.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:26.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:26.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 151, above threshold 10. [2023-01-14T23:08:27.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 158530 ms [2023-01-14T23:08:27.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:27.910+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:27.914+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:27.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:27.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:27.914+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 152, above threshold 10. [2023-01-14T23:08:28.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 159580 ms [2023-01-14T23:08:28.961+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:28.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:28.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:28.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:28.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:28.964+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 153, above threshold 10. [2023-01-14T23:08:30.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 160630 ms [2023-01-14T23:08:30.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:30.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:30.012+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:30.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:30.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:30.013+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 154, above threshold 10. [2023-01-14T23:08:31.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 161680 ms [2023-01-14T23:08:31.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:31.060+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:31.063+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:31.064+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:31.064+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:31.064+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 155, above threshold 10. [2023-01-14T23:08:32.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 162730 ms [2023-01-14T23:08:32.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:32.111+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:32.113+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:32.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:32.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:32.113+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 156, above threshold 10. [2023-01-14T23:08:33.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 163780 ms [2023-01-14T23:08:33.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:33.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:33.163+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:33.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:33.163+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:33.163+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 157, above threshold 10. [2023-01-14T23:08:34.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 164830 ms [2023-01-14T23:08:34.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:34.210+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:34.212+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:34.213+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:34.213+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:34.213+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 158, above threshold 10. [2023-01-14T23:08:34.544+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:08:34.545+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:08:34.545+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:08:34.548+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:34.548+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:34.549+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:08:35.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 165880 ms [2023-01-14T23:08:35.261+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:35.261+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:35.263+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:35.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:35.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:35.264+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 159, above threshold 10. [2023-01-14T23:08:36.312+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 166932 ms [2023-01-14T23:08:36.312+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:36.313+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:36.315+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:36.316+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:36.316+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:36.316+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 160, above threshold 10. [2023-01-14T23:08:37.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 167980 ms [2023-01-14T23:08:37.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:37.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:37.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:37.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:37.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:37.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 161, above threshold 10. [2023-01-14T23:08:38.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 169030 ms [2023-01-14T23:08:38.410+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:38.410+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:38.413+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:38.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:38.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:38.413+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 162, above threshold 10. [2023-01-14T23:08:39.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 170080 ms [2023-01-14T23:08:39.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:39.460+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:39.462+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:39.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:39.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:39.463+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 163, above threshold 10. [2023-01-14T23:08:40.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 171130 ms [2023-01-14T23:08:40.510+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:40.510+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:40.512+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:40.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:40.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:40.513+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 164, above threshold 10. [2023-01-14T23:08:41.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 172180 ms [2023-01-14T23:08:41.560+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:41.560+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:41.562+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:41.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:41.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:41.563+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 165, above threshold 10. [2023-01-14T23:08:42.610+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 173230 ms [2023-01-14T23:08:42.610+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:42.610+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:42.613+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:42.613+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:42.613+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:42.613+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 166, above threshold 10. [2023-01-14T23:08:43.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 174280 ms [2023-01-14T23:08:43.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:43.660+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:43.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:43.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:43.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:43.664+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 167, above threshold 10. [2023-01-14T23:08:44.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 175330 ms [2023-01-14T23:08:44.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:44.711+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:44.713+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:44.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:44.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:44.714+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 168, above threshold 10. [2023-01-14T23:08:45.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 176380 ms [2023-01-14T23:08:45.761+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:45.761+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:45.764+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:45.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:45.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:45.766+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 169, above threshold 10. [2023-01-14T23:08:46.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 177430 ms [2023-01-14T23:08:46.811+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:46.811+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:46.813+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:46.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:46.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:46.814+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 170, above threshold 10. [2023-01-14T23:08:47.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 178480 ms [2023-01-14T23:08:47.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:47.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:47.863+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:47.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:47.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:47.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 171, above threshold 10. [2023-01-14T23:08:48.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 179530 ms [2023-01-14T23:08:48.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:48.911+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:48.913+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:48.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:48.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:48.914+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 172, above threshold 10. [2023-01-14T23:08:49.549+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:08:49.550+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:08:49.550+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:08:49.553+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:49.553+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:49.553+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:08:49.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 180580 ms [2023-01-14T23:08:49.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:49.960+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:49.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:49.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:49.963+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:49.963+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 173, above threshold 10. [2023-01-14T23:08:51.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 181630 ms [2023-01-14T23:08:51.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:51.011+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:51.013+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:51.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:51.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:51.013+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 174, above threshold 10. [2023-01-14T23:08:52.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 182680 ms [2023-01-14T23:08:52.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:52.061+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:52.065+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:52.065+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:52.065+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:52.066+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 175, above threshold 10. [2023-01-14T23:08:53.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 183730 ms [2023-01-14T23:08:53.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:53.110+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:53.113+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:53.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:53.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:53.113+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 176, above threshold 10. [2023-01-14T23:08:54.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 184780 ms [2023-01-14T23:08:54.160+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:54.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:54.163+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:54.164+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:54.164+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:54.164+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 177, above threshold 10. [2023-01-14T23:08:55.164+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 185784 ms [2023-01-14T23:08:55.164+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:55.165+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:55.167+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:55.170+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:55.170+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:55.170+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 178, above threshold 10. [2023-01-14T23:08:56.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 186830 ms [2023-01-14T23:08:56.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:56.210+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:56.213+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:56.213+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:56.213+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:56.213+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 179, above threshold 10. [2023-01-14T23:08:57.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 187880 ms [2023-01-14T23:08:57.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:57.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:57.264+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:57.265+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:57.265+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:57.265+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 180, above threshold 10. [2023-01-14T23:08:58.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 188930 ms [2023-01-14T23:08:58.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:58.310+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:58.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:58.313+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:58.313+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:58.313+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 181, above threshold 10. [2023-01-14T23:08:59.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 189980 ms [2023-01-14T23:08:59.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:08:59.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:08:59.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:08:59.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:08:59.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:08:59.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 182, above threshold 10. [2023-01-14T23:09:00.413+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 191033 ms [2023-01-14T23:09:00.413+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:00.413+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:00.416+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:00.416+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:00.416+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:00.416+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 183, above threshold 10. [2023-01-14T23:09:01.464+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 192084 ms [2023-01-14T23:09:01.464+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:01.464+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:01.466+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:01.467+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:01.467+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:01.467+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 184, above threshold 10. [2023-01-14T23:09:02.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 193130 ms [2023-01-14T23:09:02.510+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:02.510+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:02.513+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:02.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:02.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:02.513+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 185, above threshold 10. [2023-01-14T23:09:03.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 194180 ms [2023-01-14T23:09:03.560+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:03.560+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:03.563+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:03.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:03.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:03.563+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 186, above threshold 10. [2023-01-14T23:09:04.554+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:09:04.554+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:09:04.554+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:09:04.557+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:04.557+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:04.557+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:09:04.611+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 195230 ms [2023-01-14T23:09:04.611+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:04.611+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:04.614+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:04.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:04.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:04.614+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 187, above threshold 10. [2023-01-14T23:09:05.664+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 196284 ms [2023-01-14T23:09:05.664+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:05.664+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:05.669+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:05.670+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:05.670+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:05.670+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 188, above threshold 10. [2023-01-14T23:09:06.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 197330 ms [2023-01-14T23:09:06.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:06.710+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:06.713+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:06.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:06.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:06.714+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 189, above threshold 10. [2023-01-14T23:09:07.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 198380 ms [2023-01-14T23:09:07.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:07.761+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:07.764+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:07.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:07.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:07.765+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 190, above threshold 10. [2023-01-14T23:09:08.812+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 199432 ms [2023-01-14T23:09:08.812+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:08.812+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:08.817+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:08.817+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:08.817+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:08.817+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 191, above threshold 10. [2023-01-14T23:09:09.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 200480 ms [2023-01-14T23:09:09.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:09.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:09.869+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:09.869+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:09.869+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:09.869+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 192, above threshold 10. [2023-01-14T23:09:10.911+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 201530 ms [2023-01-14T23:09:10.911+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:10.911+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:10.914+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:10.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:10.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:10.914+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 193, above threshold 10. [2023-01-14T23:09:11.964+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 202584 ms [2023-01-14T23:09:11.964+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:11.964+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:11.969+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:11.969+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:11.969+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:11.969+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 194, above threshold 10. [2023-01-14T23:09:13.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 203630 ms [2023-01-14T23:09:13.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:13.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:13.013+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:13.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:13.013+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:13.013+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 195, above threshold 10. [2023-01-14T23:09:14.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 204680 ms [2023-01-14T23:09:14.062+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:14.062+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:14.064+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:14.066+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:14.066+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:14.066+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 196, above threshold 10. [2023-01-14T23:09:15.112+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 205730 ms [2023-01-14T23:09:15.112+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:15.113+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:15.115+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:15.115+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:15.115+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:15.115+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 197, above threshold 10. [2023-01-14T23:09:16.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 206780 ms [2023-01-14T23:09:16.161+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:16.161+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:16.171+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:16.172+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:16.172+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:16.172+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 198, above threshold 10. [2023-01-14T23:09:17.211+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 207831 ms [2023-01-14T23:09:17.212+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:17.212+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:17.218+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:17.219+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:17.219+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:17.219+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 199, above threshold 10. [2023-01-14T23:09:18.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 208880 ms [2023-01-14T23:09:18.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:18.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:18.270+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:18.271+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:18.271+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:18.271+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 200, above threshold 10. [2023-01-14T23:09:19.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 209930 ms [2023-01-14T23:09:19.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:19.310+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:19.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:19.313+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:19.313+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:19.313+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 201, above threshold 10. [2023-01-14T23:09:19.558+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:09:19.558+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:09:19.558+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:09:19.565+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:19.565+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:19.565+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:09:20.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 210980 ms [2023-01-14T23:09:20.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:20.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:20.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:20.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:20.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:20.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 202, above threshold 10. [2023-01-14T23:09:21.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 212030 ms [2023-01-14T23:09:21.410+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:21.410+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:21.413+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:21.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:21.414+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:21.414+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 203, above threshold 10. [2023-01-14T23:09:22.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 213080 ms [2023-01-14T23:09:22.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:22.460+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:22.465+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:22.465+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:22.465+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:22.465+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 204, above threshold 10. [2023-01-14T23:09:23.510+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 214130 ms [2023-01-14T23:09:23.511+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:23.511+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:23.513+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:23.514+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:23.514+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:23.514+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 205, above threshold 10. [2023-01-14T23:09:24.560+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 215180 ms [2023-01-14T23:09:24.560+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:24.561+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:24.563+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:24.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:24.564+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:24.564+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 206, above threshold 10. [2023-01-14T23:09:25.616+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 216236 ms [2023-01-14T23:09:25.616+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:25.616+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:25.618+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:25.619+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:25.619+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:25.619+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 207, above threshold 10. [2023-01-14T23:09:26.660+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 217280 ms [2023-01-14T23:09:26.660+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:26.661+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:26.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:26.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:26.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:26.663+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 208, above threshold 10. [2023-01-14T23:09:27.710+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 218330 ms [2023-01-14T23:09:27.710+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:27.710+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:27.712+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:27.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:27.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:27.713+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 209, above threshold 10. [2023-01-14T23:09:28.760+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 219380 ms [2023-01-14T23:09:28.760+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:28.761+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:28.763+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:28.764+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:28.765+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:28.765+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 210, above threshold 10. [2023-01-14T23:09:29.810+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 220430 ms [2023-01-14T23:09:29.811+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:29.811+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:29.814+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:29.814+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:29.815+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:29.815+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 211, above threshold 10. [2023-01-14T23:09:30.860+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 221480 ms [2023-01-14T23:09:30.860+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:30.860+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:30.862+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:30.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:30.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:30.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 212, above threshold 10. [2023-01-14T23:09:31.910+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 222530 ms [2023-01-14T23:09:31.910+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:31.910+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:31.912+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:31.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:31.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:31.913+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 213, above threshold 10. [2023-01-14T23:09:32.960+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 223580 ms [2023-01-14T23:09:32.960+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:32.961+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:32.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:32.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:32.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:32.964+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 214, above threshold 10. [2023-01-14T23:09:34.016+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 224636 ms [2023-01-14T23:09:34.016+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:34.017+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:34.031+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:34.031+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:34.032+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:34.032+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 215, above threshold 10. [2023-01-14T23:09:34.566+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=c642f09c-f9d8-4704-88d4-04a948d46afe, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-14T23:09:34.566+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 [2023-01-14T23:09:34.566+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/c642f09c-f9d8-4704-88d4-04a948d46afe/onap-policy-clamp-ac-pf-ppnt-8466469884-cjx6p?timeout=15000 (anonymous) ... [2023-01-14T23:09:34.569+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:34.570+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:34.570+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-14T23:09:35.060+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 225680 ms [2023-01-14T23:09:35.060+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:35.061+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:35.063+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:35.063+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:35.064+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:35.064+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 216, above threshold 10. [2023-01-14T23:09:36.110+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 226730 ms [2023-01-14T23:09:36.110+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:36.110+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:36.112+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:36.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:36.113+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:36.113+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 217, above threshold 10. [2023-01-14T23:09:37.160+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 227780 ms [2023-01-14T23:09:37.161+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:37.161+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:37.165+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:37.166+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:37.166+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:37.166+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 218, above threshold 10. [2023-01-14T23:09:38.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 228830 ms [2023-01-14T23:09:38.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:38.210+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:38.213+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:38.213+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:38.213+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:38.213+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 219, above threshold 10. [2023-01-14T23:09:39.260+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 229880 ms [2023-01-14T23:09:39.261+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:39.261+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:39.264+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:39.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:39.264+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:39.264+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 220, above threshold 10. [2023-01-14T23:09:40.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 230930 ms [2023-01-14T23:09:40.311+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:40.311+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:40.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:40.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:40.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:40.314+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 221, above threshold 10. [2023-01-14T23:09:41.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 231980 ms [2023-01-14T23:09:41.361+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:41.361+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:41.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:41.364+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:41.364+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:41.364+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 222, above threshold 10. [2023-01-14T23:09:42.410+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 233030 ms [2023-01-14T23:09:42.410+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:42.410+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:42.412+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:42.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-14T23:09:42.413+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-14T23:09:42.413+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 223, above threshold 10. [2023-01-14T23:09:43.460+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 234080 ms [2023-01-14T23:09:43.460+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-14T23:09:43.460+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-14T23:09:43.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-14T23:09:43.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/