Policy clamp policy participant config file: /opt/app/policy/clamp/etc/mounted/PolicyParticipantParameters.yaml overriding logback xml file . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.14) [2023-01-16T23:02:43.553+00:00|INFO|PolicyParticipantApplication|main] Starting PolicyParticipantApplication using Java 11.0.11 on onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb with PID 7 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) [2023-01-16T23:02:43.557+00:00|INFO|PolicyParticipantApplication|main] No active profile set, falling back to 1 default profile: "default" [2023-01-16T23:02:47.016+00:00|INFO|TomcatWebServer|main] Tomcat initialized with port(s): 8085 (http) [2023-01-16T23:02:47.042+00:00|INFO|Http11NioProtocol|main] Initializing ProtocolHandler ["http-nio-8085"] [2023-01-16T23:02:47.043+00:00|INFO|StandardService|main] Starting service [Tomcat] [2023-01-16T23:02:47.043+00:00|INFO|StandardEngine|main] Starting Servlet engine: [Apache Tomcat/9.0.62] [2023-01-16T23:02:47.272+00:00|INFO|[/onap/policyparticipant]|main] Initializing Spring embedded WebApplicationContext [2023-01-16T23:02:47.272+00:00|INFO|ServletWebServerApplicationContext|main] Root WebApplicationContext: initialization completed in 3629 ms [2023-01-16T23:02:48.087+00:00|INFO|Version|main] HV000001: Hibernate Validator 6.2.3.Final [2023-01-16T23:02:50.030+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED [2023-01-16T23:02:50.663+00:00|INFO|EndpointLinksResolver|main] Exposing 3 endpoint(s) beneath base path '/actuator' [2023-01-16T23:02:52.001+00:00|INFO|DefaultSecurityFilterChain|main] Will not secure any request [2023-01-16T23:02:52.222+00:00|INFO|Http11NioProtocol|main] Starting ProtocolHandler ["http-nio-8085"] [2023-01-16T23:02:52.251+00:00|INFO|TomcatWebServer|main] Tomcat started on port(s): 8085 (http) with context path '/onap/policyparticipant' [2023-01-16T23:02:52.761+00:00|INFO|ServiceManager|main] service manager starting [2023-01-16T23:02:52.762+00:00|INFO|ServiceManager|main] service manager starting Topic endpoint management [2023-01-16T23:02:52.771+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting [2023-01-16T23:02:52.773+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED [2023-01-16T23:02:52.777+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:02:52.783+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:02:52.775+00:00|INFO|InlineBusTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=eeef72b1-5e48-416b-a6c5-051d3e5e9593, alive=false, publisher=null]]: starting [2023-01-16T23:02:52.807+00:00|INFO|InlineDmaapTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=eeef72b1-5e48-416b-a6c5-051d3e5e9593, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created [2023-01-16T23:02:52.807+00:00|INFO|ServiceManager|main] service manager starting Publisher ParticipantMessagePublisher [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantRegisterAckListener [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantStatusReqListener [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Listener AutomationCompositionStateChangeListener [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantDeregisterAckListener [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Listener AutomationCompositionUpdateListener [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantUpdateListener [2023-01-16T23:02:52.808+00:00|INFO|ServiceManager|main] service manager starting Topic Message Dispatcher [2023-01-16T23:02:52.809+00:00|INFO|TopicBase|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@250a9031 [2023-01-16T23:02:52.809+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted [2023-01-16T23:02:52.809+00:00|INFO|ServiceManager|main] service manager started [2023-01-16T23:02:52.822+00:00|INFO|OrderedServiceImpl|main] ***** OrderedServiceImpl implementers: [] [2023-01-16T23:02:52.824+00:00|INFO|network|main] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"6a4d3b03-c2a5-4ed2-ba2b-72ab44514480","timestamp":"2023-01-16T23:02:52.810166Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-16T23:02:52.833+00:00|INFO|PolicyParticipantApplication|main] Started PolicyParticipantApplication in 10.58 seconds (JVM running for 11.838) [2023-01-16T23:02:52.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 81 ms [2023-01-16T23:02:52.914+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:52.926+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:52.929+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:52.929+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:52.930+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:02:52.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:52.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:02:53.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 1131 ms [2023-01-16T23:02:53.957+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:02:53.958+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:53.969+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:53.970+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:53.970+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:02:55.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 2181 ms [2023-01-16T23:02:55.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:02:55.008+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:55.011+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:55.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:55.012+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:02:56.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 3231 ms [2023-01-16T23:02:56.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:02:56.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:56.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:56.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:56.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:02:57.108+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 4281 ms [2023-01-16T23:02:57.108+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:02:57.108+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:57.111+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:57.112+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:57.112+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:02:58.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 5331 ms [2023-01-16T23:02:58.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:02:58.158+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:58.160+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:58.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:58.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:02:59.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 6381 ms [2023-01-16T23:02:59.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:02:59.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:02:59.210+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:02:59.211+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:02:59.211+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:00.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 7431 ms [2023-01-16T23:03:00.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:00.257+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:00.260+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:00.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:00.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:01.310+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 8484 ms [2023-01-16T23:03:01.310+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:01.311+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:01.313+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:01.314+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:01.315+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:02.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 9531 ms [2023-01-16T23:03:02.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:02.357+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:02.361+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:02.362+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:02.362+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:03.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 10581 ms [2023-01-16T23:03:03.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:03.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:03.412+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:03.412+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:03.412+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:03.412+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. [2023-01-16T23:03:04.457+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 11631 ms [2023-01-16T23:03:04.457+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:04.457+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:04.460+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:04.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:04.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:04.461+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. [2023-01-16T23:03:05.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 12681 ms [2023-01-16T23:03:05.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:05.508+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:05.511+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:05.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:05.513+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:05.513+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. [2023-01-16T23:03:06.558+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 13732 ms [2023-01-16T23:03:06.558+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:06.558+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:06.567+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:06.572+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:06.572+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:06.572+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. [2023-01-16T23:03:07.608+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 14781 ms [2023-01-16T23:03:07.608+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:07.608+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:07.614+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:07.616+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:07.616+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:07.616+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. [2023-01-16T23:03:07.932+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:03:07.932+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:03:07.932+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:03:07.937+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:07.937+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:07.937+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:03:08.658+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 15832 ms [2023-01-16T23:03:08.658+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:08.658+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:08.661+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:08.661+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:08.661+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:08.661+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. [2023-01-16T23:03:09.708+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 16882 ms [2023-01-16T23:03:09.708+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:09.708+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:09.712+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:09.712+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:09.712+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:09.712+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. [2023-01-16T23:03:10.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 17931 ms [2023-01-16T23:03:10.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:10.757+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:10.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:10.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:10.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:10.760+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. [2023-01-16T23:03:11.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 18981 ms [2023-01-16T23:03:11.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:11.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:11.810+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:11.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:11.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:11.811+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. [2023-01-16T23:03:12.857+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 20031 ms [2023-01-16T23:03:12.857+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:12.857+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:12.860+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:12.860+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:12.860+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:12.860+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. [2023-01-16T23:03:13.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 21081 ms [2023-01-16T23:03:13.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:13.908+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:13.912+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:13.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:13.913+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:13.913+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. [2023-01-16T23:03:14.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 22131 ms [2023-01-16T23:03:14.957+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:14.958+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:14.960+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:14.961+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:14.961+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:14.961+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. [2023-01-16T23:03:16.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 23181 ms [2023-01-16T23:03:16.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:16.008+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:16.011+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:16.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:16.012+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:16.012+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. [2023-01-16T23:03:17.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 24231 ms [2023-01-16T23:03:17.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:17.057+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:17.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:17.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:17.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:17.061+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. [2023-01-16T23:03:18.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 25281 ms [2023-01-16T23:03:18.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:18.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:18.110+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:18.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:18.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:18.111+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. [2023-01-16T23:03:19.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 26331 ms [2023-01-16T23:03:19.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:19.157+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:19.160+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:19.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:19.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:19.161+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. [2023-01-16T23:03:20.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 27384 ms [2023-01-16T23:03:20.211+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:20.211+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:20.214+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:20.214+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:20.214+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:20.215+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. [2023-01-16T23:03:21.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 28431 ms [2023-01-16T23:03:21.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:21.258+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:21.260+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:21.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:21.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:21.261+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. [2023-01-16T23:03:22.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 29481 ms [2023-01-16T23:03:22.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:22.308+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:22.311+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:22.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:22.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:22.312+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. [2023-01-16T23:03:22.938+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:03:22.938+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:03:22.938+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:03:22.941+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:22.941+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:22.941+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:03:23.358+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 30531 ms [2023-01-16T23:03:23.367+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:23.367+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:23.372+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:23.373+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:23.373+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:23.373+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. [2023-01-16T23:03:24.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 31581 ms [2023-01-16T23:03:24.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:24.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:24.411+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:24.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:24.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:24.411+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. [2023-01-16T23:03:25.458+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 32632 ms [2023-01-16T23:03:25.458+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:25.458+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:25.461+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:25.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:25.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:25.461+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. [2023-01-16T23:03:26.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 33681 ms [2023-01-16T23:03:26.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:26.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:26.509+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:26.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:26.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:26.511+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. [2023-01-16T23:03:27.558+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 34732 ms [2023-01-16T23:03:27.559+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:27.559+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:27.562+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:27.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:27.563+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:27.563+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. [2023-01-16T23:03:28.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 35781 ms [2023-01-16T23:03:28.608+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:28.608+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:28.613+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:28.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:28.614+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:28.614+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. [2023-01-16T23:03:29.658+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 36832 ms [2023-01-16T23:03:29.658+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:29.658+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:29.662+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:29.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:29.663+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:29.664+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. [2023-01-16T23:03:30.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 37881 ms [2023-01-16T23:03:30.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:30.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:30.714+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:30.715+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:30.715+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:30.715+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. [2023-01-16T23:03:31.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 38931 ms [2023-01-16T23:03:31.758+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:31.758+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:31.762+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:31.762+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:31.762+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:31.762+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. [2023-01-16T23:03:32.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 39981 ms [2023-01-16T23:03:32.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:32.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:32.810+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:32.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:32.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:32.811+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. [2023-01-16T23:03:33.858+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 41032 ms [2023-01-16T23:03:33.858+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:33.858+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:33.860+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:33.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:33.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:33.861+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. [2023-01-16T23:03:34.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 42081 ms [2023-01-16T23:03:34.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:34.907+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:34.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:34.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:34.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:34.910+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. [2023-01-16T23:03:35.958+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 43132 ms [2023-01-16T23:03:35.958+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:35.959+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:35.966+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:35.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:35.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:35.966+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. [2023-01-16T23:03:37.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 44184 ms [2023-01-16T23:03:37.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:37.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:37.014+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:37.015+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:37.015+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:37.015+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. [2023-01-16T23:03:37.942+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:03:37.942+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:03:37.942+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:03:37.945+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:37.946+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:37.946+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:03:38.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 45231 ms [2023-01-16T23:03:38.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:38.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:38.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:38.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:38.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:38.062+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. [2023-01-16T23:03:39.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 46281 ms [2023-01-16T23:03:39.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:39.108+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:39.111+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:39.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:39.112+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:39.113+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. [2023-01-16T23:03:40.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 47331 ms [2023-01-16T23:03:40.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:40.158+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:40.160+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:40.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:40.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:40.161+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. [2023-01-16T23:03:41.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 48381 ms [2023-01-16T23:03:41.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:41.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:41.210+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:41.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:41.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:41.210+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. [2023-01-16T23:03:42.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 49431 ms [2023-01-16T23:03:42.258+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:42.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:42.262+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:42.262+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:42.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:42.263+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. [2023-01-16T23:03:43.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 50481 ms [2023-01-16T23:03:43.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:43.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:43.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:43.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:43.312+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:43.312+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. [2023-01-16T23:03:44.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 51531 ms [2023-01-16T23:03:44.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:44.357+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:44.360+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:44.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:44.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:44.360+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. [2023-01-16T23:03:45.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 52581 ms [2023-01-16T23:03:45.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:45.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:45.410+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:45.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:45.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:45.410+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. [2023-01-16T23:03:46.457+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 53631 ms [2023-01-16T23:03:46.457+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:46.457+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:46.460+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:46.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:46.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:46.461+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. [2023-01-16T23:03:47.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 54681 ms [2023-01-16T23:03:47.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:47.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:47.509+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:47.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:47.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:47.510+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. [2023-01-16T23:03:48.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 55731 ms [2023-01-16T23:03:48.557+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:48.557+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:48.560+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:48.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:48.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:48.560+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. [2023-01-16T23:03:49.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 56781 ms [2023-01-16T23:03:49.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:49.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:49.609+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:49.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:49.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:49.610+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. [2023-01-16T23:03:50.657+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 57831 ms [2023-01-16T23:03:50.657+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:50.657+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:50.660+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:50.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:50.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:50.660+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. [2023-01-16T23:03:51.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 58881 ms [2023-01-16T23:03:51.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:51.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:51.713+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:51.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:51.714+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:51.714+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. [2023-01-16T23:03:52.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 59931 ms [2023-01-16T23:03:52.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:52.757+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:52.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:52.761+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:52.761+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:52.761+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. [2023-01-16T23:03:52.950+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:03:52.950+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:03:52.950+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:03:52.958+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:52.958+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:52.958+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:03:53.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 60981 ms [2023-01-16T23:03:53.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:53.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:53.812+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:53.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:53.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:53.813+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. [2023-01-16T23:03:54.857+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 62031 ms [2023-01-16T23:03:54.858+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:54.859+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:54.861+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:54.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:54.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:54.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. [2023-01-16T23:03:55.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 63081 ms [2023-01-16T23:03:55.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:55.908+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:55.912+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:55.914+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:55.915+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:55.915+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. [2023-01-16T23:03:56.958+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 64132 ms [2023-01-16T23:03:56.958+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:56.959+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:56.963+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:56.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:56.964+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:56.964+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. [2023-01-16T23:03:58.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 65181 ms [2023-01-16T23:03:58.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:58.007+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:58.014+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:58.018+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:58.018+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:58.018+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. [2023-01-16T23:03:59.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 66231 ms [2023-01-16T23:03:59.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:03:59.057+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:03:59.060+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:03:59.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:03:59.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:03:59.061+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. [2023-01-16T23:04:00.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 67281 ms [2023-01-16T23:04:00.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:00.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:00.109+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:00.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:00.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:00.111+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. [2023-01-16T23:04:01.158+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 68332 ms [2023-01-16T23:04:01.158+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:01.159+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:01.164+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:01.165+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:01.165+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:01.165+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. [2023-01-16T23:04:02.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 69381 ms [2023-01-16T23:04:02.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:02.208+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:02.211+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:02.212+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:02.212+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:02.212+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. [2023-01-16T23:04:03.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 70431 ms [2023-01-16T23:04:03.258+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:03.258+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:03.261+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:03.262+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:03.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:03.263+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. [2023-01-16T23:04:04.308+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 71481 ms [2023-01-16T23:04:04.308+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:04.308+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:04.311+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:04.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:04.312+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:04.312+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. [2023-01-16T23:04:05.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 72531 ms [2023-01-16T23:04:05.358+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:05.358+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:05.361+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:05.362+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:05.362+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:05.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. [2023-01-16T23:04:06.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 73581 ms [2023-01-16T23:04:06.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:06.408+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:06.411+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:06.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:06.412+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:06.412+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. [2023-01-16T23:04:07.458+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 74632 ms [2023-01-16T23:04:07.458+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:07.458+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:07.465+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:07.466+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:07.466+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:07.466+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. [2023-01-16T23:04:07.959+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:04:07.959+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:04:07.960+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:04:07.963+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:07.963+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:07.964+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:04:08.508+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 75681 ms [2023-01-16T23:04:08.508+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:08.508+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:08.511+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:08.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:08.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:08.512+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. [2023-01-16T23:04:09.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 76731 ms [2023-01-16T23:04:09.557+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:09.557+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:09.559+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:09.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:09.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:09.560+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. [2023-01-16T23:04:10.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 77781 ms [2023-01-16T23:04:10.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:10.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:10.610+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:10.611+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:10.611+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:10.611+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. [2023-01-16T23:04:11.658+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 78832 ms [2023-01-16T23:04:11.658+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:11.658+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:11.661+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:11.661+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:11.661+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:11.661+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. [2023-01-16T23:04:12.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 79881 ms [2023-01-16T23:04:12.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:12.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:12.710+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:12.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:12.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:12.710+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. [2023-01-16T23:04:13.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 80931 ms [2023-01-16T23:04:13.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:13.757+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:13.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:13.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:13.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:13.760+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. [2023-01-16T23:04:14.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 81981 ms [2023-01-16T23:04:14.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:14.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:14.809+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:14.810+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:14.810+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:14.810+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. [2023-01-16T23:04:15.858+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 83031 ms [2023-01-16T23:04:15.858+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:15.858+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:15.861+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:15.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:15.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:15.861+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. [2023-01-16T23:04:16.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 84081 ms [2023-01-16T23:04:16.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:16.907+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:16.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:16.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:16.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:16.910+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. [2023-01-16T23:04:17.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 85131 ms [2023-01-16T23:04:17.958+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:17.958+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:17.961+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:17.962+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:17.962+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:17.963+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. [2023-01-16T23:04:19.010+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 86184 ms [2023-01-16T23:04:19.010+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:19.010+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:19.014+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:19.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:19.014+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:19.014+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. [2023-01-16T23:04:20.058+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 87232 ms [2023-01-16T23:04:20.058+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:20.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:20.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:20.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:20.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:20.062+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. [2023-01-16T23:04:21.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 88281 ms [2023-01-16T23:04:21.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:21.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:21.110+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:21.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:21.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:21.110+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. [2023-01-16T23:04:22.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 89331 ms [2023-01-16T23:04:22.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:22.158+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:22.160+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:22.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:22.161+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:22.161+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. [2023-01-16T23:04:22.964+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:04:22.964+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:04:22.965+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:04:22.968+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:22.968+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:22.968+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:04:23.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 90381 ms [2023-01-16T23:04:23.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:23.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:23.210+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:23.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:23.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:23.210+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. [2023-01-16T23:04:24.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 91431 ms [2023-01-16T23:04:24.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:24.257+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:24.262+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:24.262+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:24.262+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:24.262+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. [2023-01-16T23:04:25.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 92481 ms [2023-01-16T23:04:25.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:25.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:25.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:25.310+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:25.310+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:25.310+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. [2023-01-16T23:04:26.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 93531 ms [2023-01-16T23:04:26.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:26.357+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:26.360+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:26.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:26.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:26.360+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. [2023-01-16T23:04:27.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 94581 ms [2023-01-16T23:04:27.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:27.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:27.409+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:27.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:27.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:27.410+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. [2023-01-16T23:04:28.457+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 95631 ms [2023-01-16T23:04:28.457+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:28.457+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:28.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:28.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:28.464+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:28.464+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 92, above threshold 10. [2023-01-16T23:04:29.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 96681 ms [2023-01-16T23:04:29.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:29.508+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:29.511+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:29.512+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:29.512+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:29.512+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 93, above threshold 10. [2023-01-16T23:04:30.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 97731 ms [2023-01-16T23:04:30.557+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:30.557+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:30.560+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:30.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:30.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:30.560+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 94, above threshold 10. [2023-01-16T23:04:31.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 98781 ms [2023-01-16T23:04:31.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:31.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:31.610+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:31.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:31.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:31.610+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 95, above threshold 10. [2023-01-16T23:04:32.657+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 99831 ms [2023-01-16T23:04:32.657+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:32.657+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:32.660+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:32.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:32.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:32.660+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 96, above threshold 10. [2023-01-16T23:04:33.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 100881 ms [2023-01-16T23:04:33.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:33.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:33.710+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:33.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:33.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:33.710+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 97, above threshold 10. [2023-01-16T23:04:34.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 101931 ms [2023-01-16T23:04:34.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:34.757+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:34.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:34.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:34.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:34.760+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 98, above threshold 10. [2023-01-16T23:04:35.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 102981 ms [2023-01-16T23:04:35.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:35.808+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:35.811+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:35.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:35.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:35.811+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 99, above threshold 10. [2023-01-16T23:04:36.858+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 104032 ms [2023-01-16T23:04:36.858+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:36.859+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:36.862+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:36.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:36.863+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:36.863+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 100, above threshold 10. [2023-01-16T23:04:37.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 105081 ms [2023-01-16T23:04:37.908+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:37.908+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:37.911+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:37.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:37.912+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:37.912+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 101, above threshold 10. [2023-01-16T23:04:37.968+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:04:37.969+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:04:37.969+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:04:37.972+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:37.972+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:37.972+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:04:38.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 106131 ms [2023-01-16T23:04:38.957+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:38.957+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:38.960+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:38.960+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:38.960+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:38.960+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 102, above threshold 10. [2023-01-16T23:04:40.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 107181 ms [2023-01-16T23:04:40.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:40.007+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:40.010+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:40.010+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:40.010+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:40.010+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 103, above threshold 10. [2023-01-16T23:04:41.058+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 108232 ms [2023-01-16T23:04:41.058+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:41.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:41.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:41.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:41.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:41.062+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 104, above threshold 10. [2023-01-16T23:04:42.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 109281 ms [2023-01-16T23:04:42.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:42.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:42.110+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:42.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:42.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:42.111+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 105, above threshold 10. [2023-01-16T23:04:43.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 110331 ms [2023-01-16T23:04:43.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:43.157+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:43.159+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:43.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:43.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:43.160+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 106, above threshold 10. [2023-01-16T23:04:44.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 111381 ms [2023-01-16T23:04:44.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:44.208+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:44.210+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:44.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:44.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:44.211+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 107, above threshold 10. [2023-01-16T23:04:45.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 112431 ms [2023-01-16T23:04:45.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:45.258+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:45.260+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:45.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:45.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:45.261+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 108, above threshold 10. [2023-01-16T23:04:46.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 113481 ms [2023-01-16T23:04:46.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:46.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:46.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:46.310+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:46.310+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:46.310+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 109, above threshold 10. [2023-01-16T23:04:47.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 114531 ms [2023-01-16T23:04:47.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:47.357+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:47.360+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:47.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:47.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:47.360+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 110, above threshold 10. [2023-01-16T23:04:48.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 115581 ms [2023-01-16T23:04:48.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:48.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:48.410+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:48.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:48.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:48.411+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 111, above threshold 10. [2023-01-16T23:04:49.458+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 116631 ms [2023-01-16T23:04:49.458+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:49.458+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:49.460+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:49.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:49.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-16T23:04:49.461+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 112, above threshold 10. [2023-01-16T23:04:49.484+00:00|INFO|network|pool-2-thread-1] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"},"timeStamp":"2023-01-16T23:04:49.444932Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"automationCompositionInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"0e1cb75f-7fdc-422e-96c6-bc409ad2f7ad","timestamp":"2023-01-16T23:04:49.445547Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-16T23:04:50.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 117681 ms [2023-01-16T23:04:50.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:50.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:50.510+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:50.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:50.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:50.510+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 113, above threshold 10. [2023-01-16T23:04:51.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 118731 ms [2023-01-16T23:04:51.557+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:51.558+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:51.561+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:51.561+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:51.562+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:51.562+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 114, above threshold 10. [2023-01-16T23:04:52.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 119781 ms [2023-01-16T23:04:52.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:52.608+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:52.610+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:52.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:52.611+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:52.611+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 115, above threshold 10. [2023-01-16T23:04:52.973+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:04:52.973+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:04:52.974+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:04:52.977+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:52.977+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:52.977+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:04:53.657+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 120831 ms [2023-01-16T23:04:53.657+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:53.657+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:53.660+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:53.661+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:53.661+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:53.661+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 116, above threshold 10. [2023-01-16T23:04:54.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 121881 ms [2023-01-16T23:04:54.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:54.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:54.712+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:54.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:54.713+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:54.713+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 117, above threshold 10. [2023-01-16T23:04:55.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 122931 ms [2023-01-16T23:04:55.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:55.758+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:55.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:55.761+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:55.761+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:55.761+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 118, above threshold 10. [2023-01-16T23:04:56.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 123981 ms [2023-01-16T23:04:56.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:56.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:56.810+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:56.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:56.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:56.811+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 119, above threshold 10. [2023-01-16T23:04:57.858+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 125032 ms [2023-01-16T23:04:57.858+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:57.862+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:57.870+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:57.871+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:57.871+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:57.871+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 120, above threshold 10. [2023-01-16T23:04:58.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 126081 ms [2023-01-16T23:04:58.908+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:58.908+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:58.911+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:58.912+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:58.912+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:58.913+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 121, above threshold 10. [2023-01-16T23:04:59.958+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 127132 ms [2023-01-16T23:04:59.958+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:04:59.959+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:04:59.966+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:04:59.967+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:04:59.967+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:04:59.967+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 122, above threshold 10. [2023-01-16T23:05:01.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 128181 ms [2023-01-16T23:05:01.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:01.008+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:01.010+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:01.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:01.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:01.011+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 123, above threshold 10. [2023-01-16T23:05:02.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 129231 ms [2023-01-16T23:05:02.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:02.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:02.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:02.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:02.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:02.061+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 124, above threshold 10. [2023-01-16T23:05:03.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 130281 ms [2023-01-16T23:05:03.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:03.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:03.111+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:03.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:03.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:03.111+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 125, above threshold 10. [2023-01-16T23:05:04.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 131331 ms [2023-01-16T23:05:04.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:04.157+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:04.160+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:04.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:04.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:04.161+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 126, above threshold 10. [2023-01-16T23:05:05.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 132381 ms [2023-01-16T23:05:05.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:05.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:05.211+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:05.211+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:05.211+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:05.211+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 127, above threshold 10. [2023-01-16T23:05:06.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 133431 ms [2023-01-16T23:05:06.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:06.258+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:06.260+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:06.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:06.261+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:06.261+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 128, above threshold 10. [2023-01-16T23:05:07.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 134481 ms [2023-01-16T23:05:07.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:07.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:07.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:07.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:07.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:07.311+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 129, above threshold 10. [2023-01-16T23:05:07.977+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:05:07.978+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:05:07.978+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:05:07.981+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:07.982+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:07.982+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:05:08.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 135531 ms [2023-01-16T23:05:08.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:08.358+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:08.360+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:08.361+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:08.361+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:08.361+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 130, above threshold 10. [2023-01-16T23:05:09.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 136581 ms [2023-01-16T23:05:09.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:09.408+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:09.410+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:09.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:09.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:09.411+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 131, above threshold 10. [2023-01-16T23:05:10.458+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 137632 ms [2023-01-16T23:05:10.458+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:10.458+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:10.461+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:10.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:10.461+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:10.461+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 132, above threshold 10. [2023-01-16T23:05:11.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 138681 ms [2023-01-16T23:05:11.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:11.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:11.510+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:11.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:11.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:11.510+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 133, above threshold 10. [2023-01-16T23:05:12.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 139731 ms [2023-01-16T23:05:12.558+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:12.558+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:12.560+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:12.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:12.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:12.560+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 134, above threshold 10. [2023-01-16T23:05:13.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 140781 ms [2023-01-16T23:05:13.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:13.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:13.610+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:13.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:13.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:13.610+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 135, above threshold 10. [2023-01-16T23:05:14.658+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 141832 ms [2023-01-16T23:05:14.658+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:14.658+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:14.663+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:14.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:14.664+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:14.664+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 136, above threshold 10. [2023-01-16T23:05:15.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 142881 ms [2023-01-16T23:05:15.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:15.708+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:15.710+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:15.711+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:15.711+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:15.711+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 137, above threshold 10. [2023-01-16T23:05:16.758+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 143932 ms [2023-01-16T23:05:16.758+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:16.762+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:16.766+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:16.767+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:16.767+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:16.767+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 138, above threshold 10. [2023-01-16T23:05:17.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 144981 ms [2023-01-16T23:05:17.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:17.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:17.810+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:17.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:17.812+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:17.812+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 139, above threshold 10. [2023-01-16T23:05:18.858+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 146032 ms [2023-01-16T23:05:18.858+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:18.858+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:18.861+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:18.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:18.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:18.862+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 140, above threshold 10. [2023-01-16T23:05:19.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 147081 ms [2023-01-16T23:05:19.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:19.907+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:19.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:19.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:19.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:19.911+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 141, above threshold 10. [2023-01-16T23:05:20.958+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 148132 ms [2023-01-16T23:05:20.958+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:20.959+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:20.961+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:20.962+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:20.962+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:20.962+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 142, above threshold 10. [2023-01-16T23:05:22.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 149181 ms [2023-01-16T23:05:22.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:22.008+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:22.010+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:22.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:22.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:22.011+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 143, above threshold 10. [2023-01-16T23:05:22.982+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:05:22.982+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:05:22.982+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:05:22.985+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:22.985+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:22.986+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:05:23.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 150231 ms [2023-01-16T23:05:23.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:23.057+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:23.060+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:23.060+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:23.060+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:23.060+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 144, above threshold 10. [2023-01-16T23:05:24.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 151281 ms [2023-01-16T23:05:24.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:24.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:24.110+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:24.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:24.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:24.110+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 145, above threshold 10. [2023-01-16T23:05:25.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 152331 ms [2023-01-16T23:05:25.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:25.157+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:25.164+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:25.165+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:25.165+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:25.165+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 146, above threshold 10. [2023-01-16T23:05:26.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 153381 ms [2023-01-16T23:05:26.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:26.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:26.211+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:26.211+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:26.211+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:26.211+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 147, above threshold 10. [2023-01-16T23:05:27.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 154431 ms [2023-01-16T23:05:27.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:27.257+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:27.259+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:27.260+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:27.260+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:27.260+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 148, above threshold 10. [2023-01-16T23:05:28.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 155481 ms [2023-01-16T23:05:28.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:28.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:28.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:28.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:28.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:28.311+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 149, above threshold 10. [2023-01-16T23:05:29.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 156531 ms [2023-01-16T23:05:29.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:29.357+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:29.359+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:29.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:29.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:29.360+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 150, above threshold 10. [2023-01-16T23:05:30.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 157581 ms [2023-01-16T23:05:30.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:30.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:30.411+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:30.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:30.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:30.412+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 151, above threshold 10. [2023-01-16T23:05:31.457+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 158631 ms [2023-01-16T23:05:31.457+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:31.457+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:31.460+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:31.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:31.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:31.460+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 152, above threshold 10. [2023-01-16T23:05:32.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 159681 ms [2023-01-16T23:05:32.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:32.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:32.511+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:32.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:32.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:32.511+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 153, above threshold 10. [2023-01-16T23:05:33.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 160731 ms [2023-01-16T23:05:33.557+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:33.557+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:33.560+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:33.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:33.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:33.560+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 154, above threshold 10. [2023-01-16T23:05:34.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 161781 ms [2023-01-16T23:05:34.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:34.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:34.610+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:34.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:34.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:34.610+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 155, above threshold 10. [2023-01-16T23:05:35.657+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 162831 ms [2023-01-16T23:05:35.657+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:35.657+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:35.660+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:35.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:35.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:35.660+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 156, above threshold 10. [2023-01-16T23:05:36.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 163881 ms [2023-01-16T23:05:36.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:36.708+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:36.711+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:36.711+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:36.711+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:36.711+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 157, above threshold 10. [2023-01-16T23:05:37.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 164931 ms [2023-01-16T23:05:37.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:37.757+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:37.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:37.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:37.760+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:37.760+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 158, above threshold 10. [2023-01-16T23:05:37.986+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:05:37.986+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:05:37.986+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:05:37.989+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:37.990+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:37.990+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:05:38.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 165981 ms [2023-01-16T23:05:38.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:38.808+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:38.811+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:38.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:38.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:38.811+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 159, above threshold 10. [2023-01-16T23:05:39.857+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 167031 ms [2023-01-16T23:05:39.857+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:39.857+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:39.860+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:39.860+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:39.860+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:39.860+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 160, above threshold 10. [2023-01-16T23:05:40.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 168081 ms [2023-01-16T23:05:40.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:40.907+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:40.909+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:40.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:40.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:40.910+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 161, above threshold 10. [2023-01-16T23:05:41.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 169131 ms [2023-01-16T23:05:41.957+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:41.957+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:41.959+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:41.960+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:41.960+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:41.960+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 162, above threshold 10. [2023-01-16T23:05:43.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 170181 ms [2023-01-16T23:05:43.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:43.007+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:43.010+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:43.010+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:43.010+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:43.010+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 163, above threshold 10. [2023-01-16T23:05:44.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 171231 ms [2023-01-16T23:05:44.058+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:44.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:44.061+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:44.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:44.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:44.062+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 164, above threshold 10. [2023-01-16T23:05:45.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 172281 ms [2023-01-16T23:05:45.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:45.108+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:45.110+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:45.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:45.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:45.111+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 165, above threshold 10. [2023-01-16T23:05:46.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 173331 ms [2023-01-16T23:05:46.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:46.157+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:46.159+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:46.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:46.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:46.160+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 166, above threshold 10. [2023-01-16T23:05:47.210+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 174384 ms [2023-01-16T23:05:47.210+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:47.210+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:47.212+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:47.212+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:47.212+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:47.212+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 167, above threshold 10. [2023-01-16T23:05:48.258+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 175432 ms [2023-01-16T23:05:48.258+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:48.258+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:48.260+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:48.260+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:48.260+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:48.260+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 168, above threshold 10. [2023-01-16T23:05:49.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 176481 ms [2023-01-16T23:05:49.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:49.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:49.309+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:49.310+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:49.310+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:49.310+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 169, above threshold 10. [2023-01-16T23:05:50.360+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 177534 ms [2023-01-16T23:05:50.360+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:50.360+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:50.363+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:50.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:50.363+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:50.363+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 170, above threshold 10. [2023-01-16T23:05:51.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 178581 ms [2023-01-16T23:05:51.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:51.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:51.410+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:51.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:51.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:51.410+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 171, above threshold 10. [2023-01-16T23:05:52.458+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 179632 ms [2023-01-16T23:05:52.458+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:52.458+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:52.460+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:52.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:52.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:52.460+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 172, above threshold 10. [2023-01-16T23:05:52.991+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:05:52.991+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:05:52.991+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:05:52.994+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:52.994+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:52.994+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:05:53.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 180681 ms [2023-01-16T23:05:53.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:53.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:53.510+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:53.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:53.510+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:53.510+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 173, above threshold 10. [2023-01-16T23:05:54.557+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 181731 ms [2023-01-16T23:05:54.557+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:54.557+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:54.559+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:54.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:54.560+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:54.560+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 174, above threshold 10. [2023-01-16T23:05:55.562+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 182736 ms [2023-01-16T23:05:55.562+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:55.562+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:55.566+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:55.567+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:55.567+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:55.567+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 175, above threshold 10. [2023-01-16T23:05:56.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 183781 ms [2023-01-16T23:05:56.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:56.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:56.609+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:56.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:56.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:56.610+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 176, above threshold 10. [2023-01-16T23:05:57.658+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 184832 ms [2023-01-16T23:05:57.658+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:57.658+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:57.661+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:57.662+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:57.662+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:57.662+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 177, above threshold 10. [2023-01-16T23:05:58.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 185881 ms [2023-01-16T23:05:58.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:58.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:58.710+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:58.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:58.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:58.710+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 178, above threshold 10. [2023-01-16T23:05:59.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 186931 ms [2023-01-16T23:05:59.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:05:59.758+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:05:59.760+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:05:59.761+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:05:59.761+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:05:59.761+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 179, above threshold 10. [2023-01-16T23:06:00.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 187981 ms [2023-01-16T23:06:00.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:00.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:00.810+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:00.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:00.811+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:00.811+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 180, above threshold 10. [2023-01-16T23:06:01.857+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 189031 ms [2023-01-16T23:06:01.857+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:01.858+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:01.860+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:01.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:01.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:01.861+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 181, above threshold 10. [2023-01-16T23:06:02.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 190081 ms [2023-01-16T23:06:02.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:02.908+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:02.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:02.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:02.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:02.911+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 182, above threshold 10. [2023-01-16T23:06:03.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 191131 ms [2023-01-16T23:06:03.957+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:03.958+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:03.960+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:03.961+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:03.961+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:03.961+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 183, above threshold 10. [2023-01-16T23:06:05.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 192181 ms [2023-01-16T23:06:05.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:05.008+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:05.010+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:05.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:05.012+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:05.012+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 184, above threshold 10. [2023-01-16T23:06:06.057+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 193231 ms [2023-01-16T23:06:06.057+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:06.058+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:06.060+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:06.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:06.061+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:06.061+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 185, above threshold 10. [2023-01-16T23:06:07.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 194281 ms [2023-01-16T23:06:07.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:07.108+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:07.110+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:07.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:07.111+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:07.111+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 186, above threshold 10. [2023-01-16T23:06:07.998+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:06:07.999+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:06:07.999+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:06:08.009+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:08.009+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:08.009+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:06:08.159+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 195333 ms [2023-01-16T23:06:08.159+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:08.160+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:08.162+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:08.162+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:08.162+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:08.162+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 187, above threshold 10. [2023-01-16T23:06:09.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 196381 ms [2023-01-16T23:06:09.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:09.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:09.210+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:09.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:09.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:09.210+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 188, above threshold 10. [2023-01-16T23:06:10.257+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 197431 ms [2023-01-16T23:06:10.257+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:10.257+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:10.259+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:10.260+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:10.260+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:10.260+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 189, above threshold 10. [2023-01-16T23:06:11.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 198481 ms [2023-01-16T23:06:11.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:11.307+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:11.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:11.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:11.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:11.311+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 190, above threshold 10. [2023-01-16T23:06:12.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 199531 ms [2023-01-16T23:06:12.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:12.358+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:12.360+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:12.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:12.361+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:12.361+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 191, above threshold 10. [2023-01-16T23:06:13.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 200581 ms [2023-01-16T23:06:13.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:13.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:13.410+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:13.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:13.411+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:13.411+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 192, above threshold 10. [2023-01-16T23:06:14.457+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 201631 ms [2023-01-16T23:06:14.457+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:14.457+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:14.463+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:14.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:14.463+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:14.463+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 193, above threshold 10. [2023-01-16T23:06:15.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 202681 ms [2023-01-16T23:06:15.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:15.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:15.510+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:15.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:15.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:15.511+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 194, above threshold 10. [2023-01-16T23:06:16.558+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 203732 ms [2023-01-16T23:06:16.558+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:16.558+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:16.566+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:16.566+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:16.566+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:16.567+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 195, above threshold 10. [2023-01-16T23:06:17.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 204781 ms [2023-01-16T23:06:17.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:17.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:17.611+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:17.611+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:17.611+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:17.611+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 196, above threshold 10. [2023-01-16T23:06:18.657+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 205831 ms [2023-01-16T23:06:18.657+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:18.657+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:18.660+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:18.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:18.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:18.660+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 197, above threshold 10. [2023-01-16T23:06:19.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 206881 ms [2023-01-16T23:06:19.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:19.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:19.710+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:19.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:19.710+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:19.710+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 198, above threshold 10. [2023-01-16T23:06:20.757+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 207931 ms [2023-01-16T23:06:20.757+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:20.757+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:20.765+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:20.766+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:20.766+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:20.766+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 199, above threshold 10. [2023-01-16T23:06:21.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 208981 ms [2023-01-16T23:06:21.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:21.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:21.813+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:21.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:21.813+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:21.813+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 200, above threshold 10. [2023-01-16T23:06:22.857+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 210031 ms [2023-01-16T23:06:22.857+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:22.857+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:22.861+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:22.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:22.862+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:22.862+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 201, above threshold 10. [2023-01-16T23:06:23.012+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:06:23.012+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:06:23.012+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:06:23.015+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:23.015+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:23.015+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:06:23.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 211081 ms [2023-01-16T23:06:23.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:23.907+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:23.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:23.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:23.910+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:23.910+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 202, above threshold 10. [2023-01-16T23:06:24.958+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 212132 ms [2023-01-16T23:06:24.958+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:24.958+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:24.966+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:24.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:24.966+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:24.966+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 203, above threshold 10. [2023-01-16T23:06:26.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 213181 ms [2023-01-16T23:06:26.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:26.007+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:26.011+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:26.012+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:26.012+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:26.012+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 204, above threshold 10. [2023-01-16T23:06:27.058+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 214232 ms [2023-01-16T23:06:27.058+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:27.059+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:27.062+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:27.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:27.062+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:27.062+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 205, above threshold 10. [2023-01-16T23:06:28.107+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 215281 ms [2023-01-16T23:06:28.107+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:28.107+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:28.109+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:28.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:28.110+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:28.110+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 206, above threshold 10. [2023-01-16T23:06:29.157+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 216331 ms [2023-01-16T23:06:29.157+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:29.157+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:29.159+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:29.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:29.160+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:29.160+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 207, above threshold 10. [2023-01-16T23:06:30.207+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 217381 ms [2023-01-16T23:06:30.207+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:30.207+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:30.209+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:30.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:30.210+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:30.210+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 208, above threshold 10. [2023-01-16T23:06:31.259+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 218433 ms [2023-01-16T23:06:31.260+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:31.260+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:31.262+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:31.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:31.263+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:31.263+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 209, above threshold 10. [2023-01-16T23:06:32.307+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 219481 ms [2023-01-16T23:06:32.307+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:32.308+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:32.310+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:32.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:32.311+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:32.311+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 210, above threshold 10. [2023-01-16T23:06:33.357+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 220531 ms [2023-01-16T23:06:33.357+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:33.357+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:33.359+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:33.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:33.360+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:33.360+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 211, above threshold 10. [2023-01-16T23:06:34.407+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 221581 ms [2023-01-16T23:06:34.407+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:34.407+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:34.410+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:34.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:34.410+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:34.410+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 212, above threshold 10. [2023-01-16T23:06:35.457+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 222631 ms [2023-01-16T23:06:35.457+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:35.457+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:35.459+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:35.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:35.460+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:35.460+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 213, above threshold 10. [2023-01-16T23:06:36.507+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 223681 ms [2023-01-16T23:06:36.507+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:36.507+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:36.511+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:36.511+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:36.512+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:36.512+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 214, above threshold 10. [2023-01-16T23:06:37.558+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 224732 ms [2023-01-16T23:06:37.558+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:37.558+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:37.560+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:37.561+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:37.561+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:37.561+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 215, above threshold 10. [2023-01-16T23:06:38.016+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-16T23:06:38.016+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 [2023-01-16T23:06:38.016+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/e8f30ccc-a2a3-4d98-b3bc-c2c8eef5bb90/onap-policy-clamp-ac-pf-ppnt-8466469884-84xsb?timeout=15000 (anonymous) ... [2023-01-16T23:06:38.019+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:38.019+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:38.019+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-16T23:06:38.607+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 225781 ms [2023-01-16T23:06:38.607+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:38.607+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:38.609+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:38.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:38.610+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:38.610+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 216, above threshold 10. [2023-01-16T23:06:39.657+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 226831 ms [2023-01-16T23:06:39.657+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:39.657+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:39.659+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:39.659+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:39.660+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:39.660+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 217, above threshold 10. [2023-01-16T23:06:40.707+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 227881 ms [2023-01-16T23:06:40.707+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:40.707+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:40.711+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:40.712+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:40.712+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:40.712+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 218, above threshold 10. [2023-01-16T23:06:41.758+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 228932 ms [2023-01-16T23:06:41.758+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:41.758+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:41.761+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:41.762+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:41.762+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:41.762+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 219, above threshold 10. [2023-01-16T23:06:42.807+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 229981 ms [2023-01-16T23:06:42.807+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:42.807+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:42.809+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:42.810+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:42.810+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:42.810+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 220, above threshold 10. [2023-01-16T23:06:43.857+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 231031 ms [2023-01-16T23:06:43.857+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:43.858+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:43.860+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:43.860+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:43.861+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:43.861+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 221, above threshold 10. [2023-01-16T23:06:44.907+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 232081 ms [2023-01-16T23:06:44.907+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:44.908+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:44.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:44.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:44.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:44.911+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 222, above threshold 10. [2023-01-16T23:06:45.957+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 233131 ms [2023-01-16T23:06:45.957+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:45.958+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:45.960+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:45.961+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-16T23:06:45.961+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-16T23:06:45.961+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 223, above threshold 10. [2023-01-16T23:06:47.007+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 234181 ms [2023-01-16T23:06:47.007+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-16T23:06:47.008+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-16T23:06:47.010+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-16T23:06:47.011+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base