By type
Policy clamp policy participant config file: /opt/app/policy/clamp/etc/mounted/PolicyParticipantParameters.yaml overriding logback xml file . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.5.14) [2023-01-15T23:08:24.880+00:00|INFO|PolicyParticipantApplication|main] Starting PolicyParticipantApplication using Java 11.0.11 on onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6 with PID 7 (/app/app.jar started by policy in /opt/app/policy/clamp/bin) [2023-01-15T23:08:24.885+00:00|INFO|PolicyParticipantApplication|main] No active profile set, falling back to 1 default profile: "default" [2023-01-15T23:08:28.720+00:00|INFO|TomcatWebServer|main] Tomcat initialized with port(s): 8085 (http) [2023-01-15T23:08:28.740+00:00|INFO|Http11NioProtocol|main] Initializing ProtocolHandler ["http-nio-8085"] [2023-01-15T23:08:28.741+00:00|INFO|StandardService|main] Starting service [Tomcat] [2023-01-15T23:08:28.741+00:00|INFO|StandardEngine|main] Starting Servlet engine: [Apache Tomcat/9.0.62] [2023-01-15T23:08:28.979+00:00|INFO|[/onap/policyparticipant]|main] Initializing Spring embedded WebApplicationContext [2023-01-15T23:08:28.979+00:00|INFO|ServletWebServerApplicationContext|main] Root WebApplicationContext: initialization completed in 3974 ms [2023-01-15T23:08:29.912+00:00|INFO|Version|main] HV000001: Hibernate Validator 6.2.3.Final [2023-01-15T23:08:31.996+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED [2023-01-15T23:08:33.045+00:00|INFO|EndpointLinksResolver|main] Exposing 3 endpoint(s) beneath base path '/actuator' [2023-01-15T23:08:36.203+00:00|INFO|DefaultSecurityFilterChain|main] Will not secure any request [2023-01-15T23:08:36.472+00:00|INFO|Http11NioProtocol|main] Starting ProtocolHandler ["http-nio-8085"] [2023-01-15T23:08:36.508+00:00|INFO|TomcatWebServer|main] Tomcat started on port(s): 8085 (http) with context path '/onap/policyparticipant' [2023-01-15T23:08:37.090+00:00|INFO|ServiceManager|main] service manager starting [2023-01-15T23:08:37.090+00:00|INFO|ServiceManager|main] service manager starting Topic endpoint management [2023-01-15T23:08:37.103+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting [2023-01-15T23:08:37.105+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED [2023-01-15T23:08:37.113+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:08:37.118+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:08:37.111+00:00|INFO|InlineBusTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=26595492-917f-49a2-955a-a382b96a3cee, alive=false, publisher=null]]: starting [2023-01-15T23:08:37.129+00:00|INFO|InlineDmaapTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=26595492-917f-49a2-955a-a382b96a3cee, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created [2023-01-15T23:08:37.129+00:00|INFO|ServiceManager|main] service manager starting Publisher ParticipantMessagePublisher [2023-01-15T23:08:37.130+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantRegisterAckListener [2023-01-15T23:08:37.130+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantStatusReqListener [2023-01-15T23:08:37.130+00:00|INFO|ServiceManager|main] service manager starting Listener AutomationCompositionStateChangeListener [2023-01-15T23:08:37.131+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantDeregisterAckListener [2023-01-15T23:08:37.131+00:00|INFO|ServiceManager|main] service manager starting Listener AutomationCompositionUpdateListener [2023-01-15T23:08:37.131+00:00|INFO|ServiceManager|main] service manager starting Listener ParticipantUpdateListener [2023-01-15T23:08:37.131+00:00|INFO|ServiceManager|main] service manager starting Topic Message Dispatcher [2023-01-15T23:08:37.131+00:00|INFO|TopicBase|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@250a9031 [2023-01-15T23:08:37.131+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted [2023-01-15T23:08:37.131+00:00|INFO|ServiceManager|main] service manager started [2023-01-15T23:08:37.143+00:00|INFO|OrderedServiceImpl|main] ***** OrderedServiceImpl implementers: [] [2023-01-15T23:08:37.145+00:00|INFO|network|main] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"messageType":"PARTICIPANT_REGISTER","messageId":"04e66384-933b-4738-9e05-74521d13ec65","timestamp":"2023-01-15T23:08:37.132053Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-15T23:08:37.154+00:00|INFO|PolicyParticipantApplication|main] Started PolicyParticipantApplication in 14.428 seconds (JVM running for 15.772) [2023-01-15T23:08:37.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 82 ms [2023-01-15T23:08:37.234+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:37.239+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:37.239+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:37.242+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:37.242+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:08:37.245+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:37.245+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:38.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 1132 ms [2023-01-15T23:08:38.280+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:38.280+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:38.294+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:38.295+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:38.295+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:39.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 2182 ms [2023-01-15T23:08:39.330+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:39.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:39.334+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:39.334+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:39.335+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:40.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 3232 ms [2023-01-15T23:08:40.380+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:40.381+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:40.384+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:40.385+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:40.385+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:41.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 4282 ms [2023-01-15T23:08:41.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:41.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:41.432+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:41.432+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:41.432+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:42.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 5332 ms [2023-01-15T23:08:42.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:42.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:42.488+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:42.489+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:42.489+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:43.531+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 6383 ms [2023-01-15T23:08:43.531+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:43.531+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:43.535+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:43.536+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:43.536+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:44.581+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 7434 ms [2023-01-15T23:08:44.581+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:44.581+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:44.657+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:44.658+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:44.658+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:45.686+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 8539 ms [2023-01-15T23:08:45.687+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:45.687+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:45.775+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:45.776+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:45.776+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:46.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 9632 ms [2023-01-15T23:08:46.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:46.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:46.782+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:46.783+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:46.783+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:47.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 10682 ms [2023-01-15T23:08:47.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:47.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:47.845+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:47.845+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:47.845+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:47.845+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. [2023-01-15T23:08:48.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 11732 ms [2023-01-15T23:08:48.880+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:48.881+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:48.886+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:48.887+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:48.887+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:48.887+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. [2023-01-15T23:08:49.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 12782 ms [2023-01-15T23:08:49.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:49.930+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:49.933+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:49.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:49.937+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:49.937+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. [2023-01-15T23:08:50.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 13832 ms [2023-01-15T23:08:50.980+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:50.980+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:50.983+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:50.984+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:50.985+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:50.985+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. [2023-01-15T23:08:52.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 14882 ms [2023-01-15T23:08:52.030+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:52.031+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:52.034+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:52.035+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:52.035+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:52.036+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. [2023-01-15T23:08:52.244+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:08:52.244+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:08:52.244+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:08:52.248+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:52.248+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:52.248+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:08:53.082+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 15935 ms [2023-01-15T23:08:53.083+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:53.083+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:53.109+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:53.109+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:53.109+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:53.109+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. [2023-01-15T23:08:54.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 16982 ms [2023-01-15T23:08:54.129+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:54.129+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:54.132+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:54.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:54.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:54.133+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. [2023-01-15T23:08:55.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 18032 ms [2023-01-15T23:08:55.179+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:55.180+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:55.184+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:55.192+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:55.192+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:55.193+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. [2023-01-15T23:08:56.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 19082 ms [2023-01-15T23:08:56.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:56.229+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:56.233+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:56.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:56.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:56.234+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. [2023-01-15T23:08:57.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 20132 ms [2023-01-15T23:08:57.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:57.280+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:57.283+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:57.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:57.284+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:57.284+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. [2023-01-15T23:08:58.330+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 21183 ms [2023-01-15T23:08:58.331+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:58.331+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:58.334+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:58.335+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:58.335+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:58.335+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. [2023-01-15T23:08:59.380+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 22233 ms [2023-01-15T23:08:59.380+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:08:59.380+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:08:59.383+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:08:59.383+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:08:59.383+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:08:59.383+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. [2023-01-15T23:09:00.430+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 23283 ms [2023-01-15T23:09:00.430+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:00.430+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:00.433+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:00.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:00.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:00.433+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. [2023-01-15T23:09:01.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 24332 ms [2023-01-15T23:09:01.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:01.480+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:01.484+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:01.485+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:01.485+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:01.485+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. [2023-01-15T23:09:02.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 25382 ms [2023-01-15T23:09:02.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:02.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:02.535+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:02.535+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:02.535+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:02.535+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. [2023-01-15T23:09:03.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 26432 ms [2023-01-15T23:09:03.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:03.580+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:03.583+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:03.584+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:03.584+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:03.584+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. [2023-01-15T23:09:04.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 27482 ms [2023-01-15T23:09:04.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:04.629+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:04.633+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:04.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:04.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:04.634+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. [2023-01-15T23:09:05.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 28532 ms [2023-01-15T23:09:05.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:05.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:05.693+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:05.693+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:05.693+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:05.693+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. [2023-01-15T23:09:06.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 29582 ms [2023-01-15T23:09:06.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:06.729+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:06.732+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:06.733+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:06.733+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:06.733+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. [2023-01-15T23:09:07.249+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:09:07.250+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:09:07.250+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:09:07.253+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:07.253+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:07.253+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:09:07.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 30632 ms [2023-01-15T23:09:07.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:07.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:07.785+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:07.786+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:07.786+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:07.786+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. [2023-01-15T23:09:08.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 31682 ms [2023-01-15T23:09:08.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:08.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:08.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:08.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:08.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:08.833+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. [2023-01-15T23:09:09.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 32732 ms [2023-01-15T23:09:09.879+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:09.879+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:09.883+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:09.883+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:09.883+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:09.883+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. [2023-01-15T23:09:10.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 33782 ms [2023-01-15T23:09:10.930+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:10.930+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:10.941+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:10.942+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:10.943+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:10.943+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. [2023-01-15T23:09:11.980+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 34833 ms [2023-01-15T23:09:11.980+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:11.981+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:11.984+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:11.984+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:11.985+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:11.985+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. [2023-01-15T23:09:13.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 35882 ms [2023-01-15T23:09:13.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:13.030+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:13.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:13.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:13.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:13.033+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. [2023-01-15T23:09:14.081+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 36934 ms [2023-01-15T23:09:14.081+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:14.082+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:14.090+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:14.091+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:14.094+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:14.094+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. [2023-01-15T23:09:15.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 37982 ms [2023-01-15T23:09:15.131+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:15.131+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:15.135+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:15.136+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:15.137+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:15.137+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. [2023-01-15T23:09:16.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 39032 ms [2023-01-15T23:09:16.179+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:16.180+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:16.182+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:16.183+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:16.183+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:16.183+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. [2023-01-15T23:09:17.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 40082 ms [2023-01-15T23:09:17.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:17.229+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:17.232+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:17.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:17.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:17.234+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. [2023-01-15T23:09:18.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 41132 ms [2023-01-15T23:09:18.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:18.279+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:18.283+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:18.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:18.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:18.283+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. [2023-01-15T23:09:19.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 42182 ms [2023-01-15T23:09:19.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:19.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:19.333+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:19.334+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:19.334+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:19.334+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. [2023-01-15T23:09:20.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 43232 ms [2023-01-15T23:09:20.379+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:20.379+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:20.383+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:20.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:20.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:20.384+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. [2023-01-15T23:09:21.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 44282 ms [2023-01-15T23:09:21.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:21.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:21.432+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:21.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:21.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:21.433+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. [2023-01-15T23:09:22.254+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:09:22.255+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:09:22.256+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:09:22.259+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:22.259+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:22.259+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:09:22.480+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 45333 ms [2023-01-15T23:09:22.480+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:22.481+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:22.485+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:22.485+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:22.485+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:22.485+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. [2023-01-15T23:09:23.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 46382 ms [2023-01-15T23:09:23.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:23.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:23.532+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:23.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:23.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:23.533+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. [2023-01-15T23:09:24.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 47432 ms [2023-01-15T23:09:24.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:24.580+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:24.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:24.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:24.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:24.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. [2023-01-15T23:09:25.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 48482 ms [2023-01-15T23:09:25.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:25.630+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:25.633+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:25.633+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:25.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:25.634+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. [2023-01-15T23:09:26.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 49532 ms [2023-01-15T23:09:26.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:26.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:26.683+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:26.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:26.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:26.684+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. [2023-01-15T23:09:27.730+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 50583 ms [2023-01-15T23:09:27.731+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:27.731+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:27.746+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:27.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:27.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:27.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. [2023-01-15T23:09:28.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 51632 ms [2023-01-15T23:09:28.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:28.780+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:28.782+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:28.783+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:28.783+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:28.783+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. [2023-01-15T23:09:29.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 52682 ms [2023-01-15T23:09:29.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:29.830+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:29.833+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:29.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:29.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:29.833+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. [2023-01-15T23:09:30.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 53732 ms [2023-01-15T23:09:30.880+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:30.880+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:30.883+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:30.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:30.885+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:30.885+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. [2023-01-15T23:09:31.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 54782 ms [2023-01-15T23:09:31.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:31.929+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:31.933+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:31.933+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:31.933+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:31.933+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. [2023-01-15T23:09:32.982+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 55835 ms [2023-01-15T23:09:32.983+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:32.983+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:32.990+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:32.991+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:32.991+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:32.991+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. [2023-01-15T23:09:34.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 56882 ms [2023-01-15T23:09:34.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:34.029+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:34.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:34.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:34.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:34.033+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. [2023-01-15T23:09:35.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 57932 ms [2023-01-15T23:09:35.079+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:35.079+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:35.082+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:35.082+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:35.082+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:35.082+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. [2023-01-15T23:09:36.137+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 58989 ms [2023-01-15T23:09:36.137+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:36.137+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:36.181+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:36.182+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:36.183+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:36.183+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. [2023-01-15T23:09:37.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 60082 ms [2023-01-15T23:09:37.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:37.229+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:37.232+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:37.233+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:37.233+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:37.233+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. [2023-01-15T23:09:37.260+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:09:37.261+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:09:37.261+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:09:37.265+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:37.265+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:37.266+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:09:38.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 61132 ms [2023-01-15T23:09:38.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:38.280+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:38.292+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:38.292+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:38.293+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:38.293+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. [2023-01-15T23:09:39.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 62182 ms [2023-01-15T23:09:39.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:39.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:39.332+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:39.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:39.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:39.333+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. [2023-01-15T23:09:40.382+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 63235 ms [2023-01-15T23:09:40.382+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:40.395+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:40.415+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:40.416+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:40.416+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:40.416+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. [2023-01-15T23:09:41.430+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 64282 ms [2023-01-15T23:09:41.430+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:41.430+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:41.433+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:41.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:41.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:41.434+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. [2023-01-15T23:09:42.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 65332 ms [2023-01-15T23:09:42.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:42.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:42.482+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:42.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:42.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:42.483+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. [2023-01-15T23:09:43.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 66382 ms [2023-01-15T23:09:43.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:43.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:43.532+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:43.532+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:43.532+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:43.532+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. [2023-01-15T23:09:44.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 67432 ms [2023-01-15T23:09:44.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:44.579+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:44.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:44.582+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:44.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:44.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. [2023-01-15T23:09:45.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 68482 ms [2023-01-15T23:09:45.630+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:45.630+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:45.633+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:45.633+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:45.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:45.634+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. [2023-01-15T23:09:46.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 69532 ms [2023-01-15T23:09:46.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:46.680+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:46.683+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:46.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:46.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:46.684+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. [2023-01-15T23:09:47.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 70582 ms [2023-01-15T23:09:47.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:47.730+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:47.732+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:47.732+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:47.732+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:47.733+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. [2023-01-15T23:09:48.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 71632 ms [2023-01-15T23:09:48.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:48.780+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:48.785+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:48.785+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:48.785+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:48.786+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. [2023-01-15T23:09:49.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 72682 ms [2023-01-15T23:09:49.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:49.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:49.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:49.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:49.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:49.833+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. [2023-01-15T23:09:50.885+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 73738 ms [2023-01-15T23:09:50.893+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:50.900+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:50.907+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:50.907+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:50.917+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:50.917+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. [2023-01-15T23:09:51.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 74782 ms [2023-01-15T23:09:51.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:51.930+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:51.933+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:51.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:51.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:51.934+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. [2023-01-15T23:09:52.269+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:09:52.270+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:09:52.270+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:09:52.274+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:52.274+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:52.274+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:09:52.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 75832 ms [2023-01-15T23:09:52.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:52.980+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:52.982+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:52.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:52.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:52.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. [2023-01-15T23:09:54.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 76882 ms [2023-01-15T23:09:54.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:54.030+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:54.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:54.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:54.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:54.033+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. [2023-01-15T23:09:55.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 77932 ms [2023-01-15T23:09:55.080+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:55.080+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:55.083+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:55.084+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:55.084+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:55.084+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. [2023-01-15T23:09:56.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 78982 ms [2023-01-15T23:09:56.129+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:56.130+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:56.132+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:56.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:56.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:56.133+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. [2023-01-15T23:09:57.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 80032 ms [2023-01-15T23:09:57.179+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:57.180+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:57.182+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:57.183+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:57.183+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:57.183+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. [2023-01-15T23:09:58.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 81082 ms [2023-01-15T23:09:58.230+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:58.230+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:58.234+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:58.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:58.235+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:58.235+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. [2023-01-15T23:09:59.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 82132 ms [2023-01-15T23:09:59.280+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:09:59.280+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:09:59.283+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:09:59.284+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:09:59.284+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:09:59.284+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. [2023-01-15T23:10:00.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 83182 ms [2023-01-15T23:10:00.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:00.329+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:00.332+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:00.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:00.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:00.333+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. [2023-01-15T23:10:01.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 84232 ms [2023-01-15T23:10:01.379+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:01.379+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:01.383+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:01.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:01.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:01.384+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. [2023-01-15T23:10:02.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 85282 ms [2023-01-15T23:10:02.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:02.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:02.433+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:02.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:02.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:02.434+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. [2023-01-15T23:10:03.482+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 86335 ms [2023-01-15T23:10:03.483+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:03.483+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:03.485+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:03.486+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:03.486+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:03.486+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. [2023-01-15T23:10:04.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 87382 ms [2023-01-15T23:10:04.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:04.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:04.533+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:04.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:04.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:04.533+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. [2023-01-15T23:10:05.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 88432 ms [2023-01-15T23:10:05.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:05.580+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:05.583+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:05.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:05.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:05.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. [2023-01-15T23:10:06.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 89482 ms [2023-01-15T23:10:06.630+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:06.631+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:06.638+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:06.639+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:06.639+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:06.639+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. [2023-01-15T23:10:07.274+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:10:07.275+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:10:07.275+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:10:07.279+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:07.279+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:07.279+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:10:07.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 90532 ms [2023-01-15T23:10:07.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:07.680+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:07.682+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:07.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:07.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:07.683+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. [2023-01-15T23:10:08.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 91582 ms [2023-01-15T23:10:08.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:08.730+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:08.735+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:08.735+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:08.736+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:08.736+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. [2023-01-15T23:10:09.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 92632 ms [2023-01-15T23:10:09.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:09.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:09.782+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:09.783+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:09.783+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:09.783+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. [2023-01-15T23:10:10.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 93682 ms [2023-01-15T23:10:10.830+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:10.830+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:10.833+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:10.834+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:10.834+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:10.834+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. [2023-01-15T23:10:11.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 94732 ms [2023-01-15T23:10:11.880+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:11.880+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:11.883+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:11.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:11.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:11.885+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. [2023-01-15T23:10:12.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 95782 ms [2023-01-15T23:10:12.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:12.929+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:12.932+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:12.932+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:12.932+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:12.933+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 92, above threshold 10. [2023-01-15T23:10:13.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 96832 ms [2023-01-15T23:10:13.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:13.979+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:13.982+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:13.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:13.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:13.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 93, above threshold 10. [2023-01-15T23:10:15.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 97882 ms [2023-01-15T23:10:15.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:15.029+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:15.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:15.032+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:15.032+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:15.032+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 94, above threshold 10. [2023-01-15T23:10:16.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 98932 ms [2023-01-15T23:10:16.079+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:16.079+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:16.083+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:16.083+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:16.084+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:16.084+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 95, above threshold 10. [2023-01-15T23:10:17.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 99982 ms [2023-01-15T23:10:17.129+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:17.129+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:17.132+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:17.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:17.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:17.133+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 96, above threshold 10. [2023-01-15T23:10:18.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 101032 ms [2023-01-15T23:10:18.179+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:18.179+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:18.182+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:18.182+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:18.182+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:18.182+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 97, above threshold 10. [2023-01-15T23:10:19.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 102082 ms [2023-01-15T23:10:19.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:19.229+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:19.232+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:19.232+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:19.232+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:19.232+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 98, above threshold 10. [2023-01-15T23:10:20.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 103132 ms [2023-01-15T23:10:20.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:20.279+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:20.283+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:20.284+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:20.284+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:20.284+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 99, above threshold 10. [2023-01-15T23:10:21.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 104182 ms [2023-01-15T23:10:21.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:21.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:21.332+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:21.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:21.338+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:21.338+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 100, above threshold 10. [2023-01-15T23:10:22.279+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:10:22.280+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:10:22.280+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:10:22.283+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:22.283+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:22.283+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:10:22.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 105232 ms [2023-01-15T23:10:22.379+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:22.379+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:22.382+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:22.382+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:22.383+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:22.383+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 101, above threshold 10. [2023-01-15T23:10:23.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 106282 ms [2023-01-15T23:10:23.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:23.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:23.432+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:23.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:23.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:23.433+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 102, above threshold 10. [2023-01-15T23:10:24.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 107332 ms [2023-01-15T23:10:24.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:24.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:24.482+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:24.482+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:24.482+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:24.482+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 103, above threshold 10. [2023-01-15T23:10:25.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 108382 ms [2023-01-15T23:10:25.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:25.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:25.532+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:25.532+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:25.532+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:25.532+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 104, above threshold 10. [2023-01-15T23:10:26.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 109432 ms [2023-01-15T23:10:26.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:26.579+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:26.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:26.582+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:26.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:26.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 105, above threshold 10. [2023-01-15T23:10:27.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 110482 ms [2023-01-15T23:10:27.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:27.630+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:27.632+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:27.633+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:27.633+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:27.633+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 106, above threshold 10. [2023-01-15T23:10:28.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 111532 ms [2023-01-15T23:10:28.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:28.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:28.682+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:28.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:28.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:28.683+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 107, above threshold 10. [2023-01-15T23:10:29.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 112582 ms [2023-01-15T23:10:29.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:29.730+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:29.732+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:29.733+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:29.734+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:29.734+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 108, above threshold 10. [2023-01-15T23:10:30.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 1 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 113632 ms [2023-01-15T23:10:30.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:30.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:30.782+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:30.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:30.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 1 message to send. [2023-01-15T23:10:30.782+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 109, above threshold 10. [2023-01-15T23:10:31.398+00:00|INFO|network|pool-2-thread-1] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"},"timeStamp":"2023-01-15T23:10:31.361756Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"automationCompositionInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"a07bf24b-e4d0-4425-9a8f-403cc2eb07fb","timestamp":"2023-01-15T23:10:31.362570Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-15T23:10:31.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 114682 ms [2023-01-15T23:10:31.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:31.830+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:31.833+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:31.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:31.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:31.833+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 110, above threshold 10. [2023-01-15T23:10:32.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 115732 ms [2023-01-15T23:10:32.879+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:32.880+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:32.882+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:32.883+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:32.883+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:32.883+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 111, above threshold 10. [2023-01-15T23:10:33.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 116782 ms [2023-01-15T23:10:33.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:33.929+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:33.932+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:33.933+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:33.933+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:33.933+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 112, above threshold 10. [2023-01-15T23:10:34.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 117832 ms [2023-01-15T23:10:34.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:34.979+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:34.982+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:34.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:34.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:34.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 113, above threshold 10. [2023-01-15T23:10:36.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 118882 ms [2023-01-15T23:10:36.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:36.029+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:36.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:36.032+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:36.032+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:36.032+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 114, above threshold 10. [2023-01-15T23:10:37.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 119932 ms [2023-01-15T23:10:37.079+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:37.080+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:37.083+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:37.083+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:37.083+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:37.083+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 115, above threshold 10. [2023-01-15T23:10:37.284+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:10:37.284+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:10:37.285+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:10:37.288+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:37.288+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:37.288+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:10:38.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 120982 ms [2023-01-15T23:10:38.129+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:38.129+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:38.132+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:38.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:38.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:38.133+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 116, above threshold 10. [2023-01-15T23:10:39.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 122032 ms [2023-01-15T23:10:39.179+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:39.180+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:39.185+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:39.185+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:39.185+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:39.185+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 117, above threshold 10. [2023-01-15T23:10:40.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 123082 ms [2023-01-15T23:10:40.230+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:40.230+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:40.233+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:40.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:40.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:40.234+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 118, above threshold 10. [2023-01-15T23:10:41.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 124132 ms [2023-01-15T23:10:41.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:41.280+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:41.284+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:41.284+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:41.285+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:41.285+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 119, above threshold 10. [2023-01-15T23:10:42.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 125182 ms [2023-01-15T23:10:42.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:42.329+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:42.332+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:42.332+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:42.332+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:42.332+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 120, above threshold 10. [2023-01-15T23:10:43.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 126232 ms [2023-01-15T23:10:43.379+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:43.380+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:43.383+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:43.383+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:43.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:43.384+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 121, above threshold 10. [2023-01-15T23:10:44.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 127282 ms [2023-01-15T23:10:44.430+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:44.430+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:44.433+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:44.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:44.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:44.434+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 122, above threshold 10. [2023-01-15T23:10:45.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 128332 ms [2023-01-15T23:10:45.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:45.480+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:45.482+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:45.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:45.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:45.483+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 123, above threshold 10. [2023-01-15T23:10:46.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 129382 ms [2023-01-15T23:10:46.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:46.530+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:46.539+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:46.540+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:46.540+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:46.541+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 124, above threshold 10. [2023-01-15T23:10:47.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 130432 ms [2023-01-15T23:10:47.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:47.579+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:47.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:47.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:47.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:47.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 125, above threshold 10. [2023-01-15T23:10:48.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 131482 ms [2023-01-15T23:10:48.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:48.630+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:48.634+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:48.635+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:48.635+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:48.635+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 126, above threshold 10. [2023-01-15T23:10:49.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 132532 ms [2023-01-15T23:10:49.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:49.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:49.683+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:49.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:49.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:49.683+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 127, above threshold 10. [2023-01-15T23:10:50.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 133582 ms [2023-01-15T23:10:50.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:50.730+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:50.734+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:50.735+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:50.735+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:50.735+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 128, above threshold 10. [2023-01-15T23:10:51.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 134632 ms [2023-01-15T23:10:51.780+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:51.780+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:51.783+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:51.784+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:51.784+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:51.784+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 129, above threshold 10. [2023-01-15T23:10:52.289+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:10:52.289+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:10:52.290+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:10:52.293+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:52.293+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:52.293+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:10:52.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 135682 ms [2023-01-15T23:10:52.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:52.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:52.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:52.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:52.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:52.833+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 130, above threshold 10. [2023-01-15T23:10:53.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 136732 ms [2023-01-15T23:10:53.880+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:53.880+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:53.883+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:53.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:53.884+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:53.884+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 131, above threshold 10. [2023-01-15T23:10:54.930+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 137783 ms [2023-01-15T23:10:54.931+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:54.931+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:54.934+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:54.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:54.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:54.934+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 132, above threshold 10. [2023-01-15T23:10:55.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 138832 ms [2023-01-15T23:10:55.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:55.979+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:55.983+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:55.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:55.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:55.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 133, above threshold 10. [2023-01-15T23:10:57.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 139882 ms [2023-01-15T23:10:57.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:57.029+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:57.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:57.032+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:57.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:57.033+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 134, above threshold 10. [2023-01-15T23:10:58.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 140932 ms [2023-01-15T23:10:58.080+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:58.080+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:58.094+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:58.095+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:58.095+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:58.095+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 135, above threshold 10. [2023-01-15T23:10:59.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 141982 ms [2023-01-15T23:10:59.130+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:10:59.133+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:10:59.136+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:10:59.140+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:10:59.140+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:10:59.140+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 136, above threshold 10. [2023-01-15T23:11:00.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 143032 ms [2023-01-15T23:11:00.179+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:00.179+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:00.182+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:00.182+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:00.182+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:00.182+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 137, above threshold 10. [2023-01-15T23:11:01.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 144082 ms [2023-01-15T23:11:01.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:01.229+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:01.233+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:01.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:01.234+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:01.234+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 138, above threshold 10. [2023-01-15T23:11:02.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 145132 ms [2023-01-15T23:11:02.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:02.279+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:02.282+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:02.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:02.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:02.283+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 139, above threshold 10. [2023-01-15T23:11:03.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 146182 ms [2023-01-15T23:11:03.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:03.329+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:03.332+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:03.332+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:03.332+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:03.332+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 140, above threshold 10. [2023-01-15T23:11:04.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 147232 ms [2023-01-15T23:11:04.380+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:04.380+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:04.384+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:04.385+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:04.385+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:04.385+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 141, above threshold 10. [2023-01-15T23:11:05.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 148282 ms [2023-01-15T23:11:05.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:05.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:05.433+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:05.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:05.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:05.433+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 142, above threshold 10. [2023-01-15T23:11:06.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 149332 ms [2023-01-15T23:11:06.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:06.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:06.483+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:06.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:06.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:06.483+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 143, above threshold 10. [2023-01-15T23:11:07.294+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:11:07.294+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:11:07.294+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:11:07.298+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:07.298+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:07.298+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:11:07.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 150382 ms [2023-01-15T23:11:07.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:07.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:07.532+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:07.532+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:07.532+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:07.532+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 144, above threshold 10. [2023-01-15T23:11:08.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 151432 ms [2023-01-15T23:11:08.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:08.579+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:08.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:08.582+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:08.582+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:08.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 145, above threshold 10. [2023-01-15T23:11:09.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 152482 ms [2023-01-15T23:11:09.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:09.629+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:09.635+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:09.636+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:09.636+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:09.636+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 146, above threshold 10. [2023-01-15T23:11:10.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 153532 ms [2023-01-15T23:11:10.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:10.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:10.682+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:10.682+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:10.682+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:10.682+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 147, above threshold 10. [2023-01-15T23:11:11.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 154582 ms [2023-01-15T23:11:11.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:11.729+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:11.732+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:11.733+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:11.733+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:11.733+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 148, above threshold 10. [2023-01-15T23:11:12.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 155632 ms [2023-01-15T23:11:12.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:12.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:12.782+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:12.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:12.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:12.782+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 149, above threshold 10. [2023-01-15T23:11:13.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 156682 ms [2023-01-15T23:11:13.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:13.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:13.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:13.832+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:13.832+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:13.832+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 150, above threshold 10. [2023-01-15T23:11:14.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 157732 ms [2023-01-15T23:11:14.880+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:14.880+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:14.885+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:14.887+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:14.890+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:14.890+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 151, above threshold 10. [2023-01-15T23:11:15.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 158782 ms [2023-01-15T23:11:15.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:15.930+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:15.933+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:15.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:15.934+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:15.934+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 152, above threshold 10. [2023-01-15T23:11:16.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 159832 ms [2023-01-15T23:11:16.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:16.980+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:16.983+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:16.984+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:16.984+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:16.984+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 153, above threshold 10. [2023-01-15T23:11:18.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 160882 ms [2023-01-15T23:11:18.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:18.029+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:18.033+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:18.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:18.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:18.033+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 154, above threshold 10. [2023-01-15T23:11:19.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 161932 ms [2023-01-15T23:11:19.080+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:19.080+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:19.084+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:19.085+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:19.085+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:19.085+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 155, above threshold 10. [2023-01-15T23:11:20.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 162982 ms [2023-01-15T23:11:20.130+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:20.131+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:20.137+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:20.138+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:20.139+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:20.139+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 156, above threshold 10. [2023-01-15T23:11:21.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 164032 ms [2023-01-15T23:11:21.180+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:21.180+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:21.184+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:21.184+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:21.184+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:21.185+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 157, above threshold 10. [2023-01-15T23:11:22.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 165082 ms [2023-01-15T23:11:22.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:22.230+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:22.232+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:22.233+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:22.233+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:22.233+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 158, above threshold 10. [2023-01-15T23:11:22.299+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:11:22.300+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:11:22.300+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:11:22.303+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:22.303+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:22.304+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:11:23.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 166132 ms [2023-01-15T23:11:23.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:23.280+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:23.282+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:23.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:23.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:23.283+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 159, above threshold 10. [2023-01-15T23:11:24.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 167182 ms [2023-01-15T23:11:24.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:24.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:24.333+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:24.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:24.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:24.333+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 160, above threshold 10. [2023-01-15T23:11:25.382+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 168235 ms [2023-01-15T23:11:25.383+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:25.383+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:25.395+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:25.396+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:25.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:25.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 161, above threshold 10. [2023-01-15T23:11:26.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 169282 ms [2023-01-15T23:11:26.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:26.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:26.433+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:26.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:26.434+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:26.434+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 162, above threshold 10. [2023-01-15T23:11:27.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 170332 ms [2023-01-15T23:11:27.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:27.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:27.482+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:27.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:27.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:27.483+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 163, above threshold 10. [2023-01-15T23:11:28.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 171382 ms [2023-01-15T23:11:28.530+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:28.530+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:28.533+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:28.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:28.534+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:28.534+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 164, above threshold 10. [2023-01-15T23:11:29.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 172432 ms [2023-01-15T23:11:29.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:29.580+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:29.584+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:29.584+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:29.584+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:29.585+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 165, above threshold 10. [2023-01-15T23:11:30.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 173482 ms [2023-01-15T23:11:30.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:30.630+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:30.634+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:30.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:30.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:30.635+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 166, above threshold 10. [2023-01-15T23:11:31.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 174532 ms [2023-01-15T23:11:31.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:31.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:31.682+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:31.682+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:31.683+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:31.683+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 167, above threshold 10. [2023-01-15T23:11:32.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 175582 ms [2023-01-15T23:11:32.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:32.729+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:32.732+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:32.732+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:32.733+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:32.733+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 168, above threshold 10. [2023-01-15T23:11:33.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 176632 ms [2023-01-15T23:11:33.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:33.780+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:33.783+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:33.784+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:33.784+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:33.784+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 169, above threshold 10. [2023-01-15T23:11:34.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 177682 ms [2023-01-15T23:11:34.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:34.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:34.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:34.832+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:34.832+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:34.832+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 170, above threshold 10. [2023-01-15T23:11:35.879+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 178732 ms [2023-01-15T23:11:35.879+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:35.880+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:35.882+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:35.883+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:35.883+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:35.883+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 171, above threshold 10. [2023-01-15T23:11:36.930+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 179783 ms [2023-01-15T23:11:36.931+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:36.931+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:36.939+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:36.940+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:36.940+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:36.940+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 172, above threshold 10. [2023-01-15T23:11:37.304+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:11:37.305+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:11:37.305+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:11:37.308+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:37.309+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:37.309+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:11:37.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 180832 ms [2023-01-15T23:11:37.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:37.979+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:37.982+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:37.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:37.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:37.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 173, above threshold 10. [2023-01-15T23:11:39.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 181882 ms [2023-01-15T23:11:39.030+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:39.031+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:39.034+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:39.035+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:39.036+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:39.036+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 174, above threshold 10. [2023-01-15T23:11:40.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 182932 ms [2023-01-15T23:11:40.079+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:40.079+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:40.085+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:40.085+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:40.085+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:40.085+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 175, above threshold 10. [2023-01-15T23:11:41.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 183982 ms [2023-01-15T23:11:41.129+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:41.130+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:41.133+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:41.133+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:41.134+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:41.134+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 176, above threshold 10. [2023-01-15T23:11:42.179+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 185032 ms [2023-01-15T23:11:42.180+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:42.186+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:42.193+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:42.194+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:42.195+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:42.195+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 177, above threshold 10. [2023-01-15T23:11:43.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 186082 ms [2023-01-15T23:11:43.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:43.230+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:43.234+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:43.235+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:43.235+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:43.235+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 178, above threshold 10. [2023-01-15T23:11:44.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 187132 ms [2023-01-15T23:11:44.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:44.279+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:44.282+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:44.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:44.283+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:44.283+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 179, above threshold 10. [2023-01-15T23:11:45.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 188182 ms [2023-01-15T23:11:45.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:45.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:45.333+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:45.333+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:45.334+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:45.334+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 180, above threshold 10. [2023-01-15T23:11:46.379+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 189232 ms [2023-01-15T23:11:46.379+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:46.380+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:46.383+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:46.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:46.384+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:46.384+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 181, above threshold 10. [2023-01-15T23:11:47.429+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 190282 ms [2023-01-15T23:11:47.429+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:47.429+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:47.432+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:47.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:47.433+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:47.433+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 182, above threshold 10. [2023-01-15T23:11:48.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 191332 ms [2023-01-15T23:11:48.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:48.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:48.482+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:48.482+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:48.482+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:48.482+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 183, above threshold 10. [2023-01-15T23:11:49.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 192382 ms [2023-01-15T23:11:49.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:49.530+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:49.532+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:49.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:49.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:49.533+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 184, above threshold 10. [2023-01-15T23:11:50.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 193432 ms [2023-01-15T23:11:50.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:50.579+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:50.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:50.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:50.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:50.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 185, above threshold 10. [2023-01-15T23:11:51.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 194482 ms [2023-01-15T23:11:51.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:51.630+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:51.633+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:51.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:51.634+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:51.634+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 186, above threshold 10. [2023-01-15T23:11:52.309+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:11:52.310+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:11:52.310+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:11:52.313+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:52.313+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:52.313+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:11:52.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 195532 ms [2023-01-15T23:11:52.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:52.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:52.683+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:52.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:52.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:52.684+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 187, above threshold 10. [2023-01-15T23:11:53.730+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 196583 ms [2023-01-15T23:11:53.731+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:53.731+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:53.738+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:53.739+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:53.739+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:53.739+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 188, above threshold 10. [2023-01-15T23:11:54.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 197632 ms [2023-01-15T23:11:54.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:54.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:54.783+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:54.784+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:54.784+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:54.784+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 189, above threshold 10. [2023-01-15T23:11:55.832+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 198685 ms [2023-01-15T23:11:55.835+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:55.847+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:55.910+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:55.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:55.911+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:55.911+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 190, above threshold 10. [2023-01-15T23:11:56.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 199782 ms [2023-01-15T23:11:56.930+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:56.930+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:56.949+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:56.950+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:56.950+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:56.950+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 191, above threshold 10. [2023-01-15T23:11:57.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 200832 ms [2023-01-15T23:11:57.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:57.979+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:57.982+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:57.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:57.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:57.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 192, above threshold 10. [2023-01-15T23:11:59.006+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 201859 ms [2023-01-15T23:11:59.038+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:11:59.039+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:11:59.071+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:11:59.083+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:11:59.099+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:11:59.099+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 193, above threshold 10. [2023-01-15T23:12:00.129+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 202982 ms [2023-01-15T23:12:00.129+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:00.130+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:00.134+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:00.135+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:00.136+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:00.136+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 194, above threshold 10. [2023-01-15T23:12:01.183+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 204036 ms [2023-01-15T23:12:01.183+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:01.213+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:01.231+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:01.232+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:01.232+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:01.232+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 195, above threshold 10. [2023-01-15T23:12:02.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 205132 ms [2023-01-15T23:12:02.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:02.279+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:02.281+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:02.282+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:02.282+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:02.282+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 196, above threshold 10. [2023-01-15T23:12:03.329+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 206182 ms [2023-01-15T23:12:03.329+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:03.330+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:03.333+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:03.334+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:03.334+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:03.334+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 197, above threshold 10. [2023-01-15T23:12:04.380+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 207233 ms [2023-01-15T23:12:04.380+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:04.380+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:04.392+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:04.393+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:04.393+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:04.393+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 198, above threshold 10. [2023-01-15T23:12:05.434+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 208287 ms [2023-01-15T23:12:05.435+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:05.436+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:05.447+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:05.456+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:05.456+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:05.456+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 199, above threshold 10. [2023-01-15T23:12:06.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 209332 ms [2023-01-15T23:12:06.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:06.480+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:06.485+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:06.486+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:06.486+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:06.486+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 200, above threshold 10. [2023-01-15T23:12:07.314+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:12:07.315+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:12:07.315+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:12:07.319+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:07.319+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:07.319+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:12:07.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 210382 ms [2023-01-15T23:12:07.530+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:07.530+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:07.533+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:07.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:07.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:07.533+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 201, above threshold 10. [2023-01-15T23:12:08.582+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 211435 ms [2023-01-15T23:12:08.586+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:08.587+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:08.599+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:08.599+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:08.600+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:08.600+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 202, above threshold 10. [2023-01-15T23:12:09.629+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 212482 ms [2023-01-15T23:12:09.629+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:09.629+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:09.632+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:09.632+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:09.632+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:09.632+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 203, above threshold 10. [2023-01-15T23:12:10.679+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 213532 ms [2023-01-15T23:12:10.679+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:10.679+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:10.685+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:10.685+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:10.685+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:10.685+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 204, above threshold 10. [2023-01-15T23:12:11.734+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 214587 ms [2023-01-15T23:12:11.735+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:11.735+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:11.744+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:11.744+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:11.744+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:11.744+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 205, above threshold 10. [2023-01-15T23:12:12.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 215632 ms [2023-01-15T23:12:12.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:12.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:12.781+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:12.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:12.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:12.782+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 206, above threshold 10. [2023-01-15T23:12:13.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 216682 ms [2023-01-15T23:12:13.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:13.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:13.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:13.832+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:13.832+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:13.832+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 207, above threshold 10. [2023-01-15T23:12:14.881+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 217734 ms [2023-01-15T23:12:14.882+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:14.882+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:14.885+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:14.886+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:14.886+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:14.886+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 208, above threshold 10. [2023-01-15T23:12:15.929+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 218782 ms [2023-01-15T23:12:15.929+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:15.930+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:15.932+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:15.936+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:15.936+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:15.936+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 209, above threshold 10. [2023-01-15T23:12:16.979+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 219832 ms [2023-01-15T23:12:16.979+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:16.980+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:16.982+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:16.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:16.983+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:16.983+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 210, above threshold 10. [2023-01-15T23:12:18.029+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 220882 ms [2023-01-15T23:12:18.029+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:18.030+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:18.032+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:18.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:18.033+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:18.033+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 211, above threshold 10. [2023-01-15T23:12:19.079+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 221932 ms [2023-01-15T23:12:19.079+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:19.079+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:19.082+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:19.083+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:19.083+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:19.083+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 212, above threshold 10. [2023-01-15T23:12:20.133+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 222986 ms [2023-01-15T23:12:20.133+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:20.133+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:20.181+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:20.205+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:20.205+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:20.205+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 213, above threshold 10. [2023-01-15T23:12:21.229+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 224082 ms [2023-01-15T23:12:21.229+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:21.229+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:21.232+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:21.232+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:21.233+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:21.233+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 214, above threshold 10. [2023-01-15T23:12:22.279+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 225132 ms [2023-01-15T23:12:22.279+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:22.279+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:22.282+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:22.282+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:22.282+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:22.282+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 215, above threshold 10. [2023-01-15T23:12:22.323+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=4baf15e9-bfea-4749-beab-58e59b30bc9a, consumerInstance=onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=POLICY-ACRUNTIME-PARTICIPANT, effectiveTopic=POLICY-ACRUNTIME-PARTICIPANT, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch java.io.IOException: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:123) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:212) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) at java.base/java.lang.Thread.run(Unknown Source) Caused by: com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) ... 5 common frames omitted [2023-01-15T23:12:22.323+00:00|INFO|CambriaConsumerImpl|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] UEB GET /events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 [2023-01-15T23:12:22.324+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] GET http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT/4baf15e9-bfea-4749-beab-58e59b30bc9a/onap-policy-clamp-ac-pf-ppnt-8466469884-6f8n6?timeout=15000 (anonymous) ... [2023-01-15T23:12:22.334+00:00|INFO|HttpClient|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:22.335+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:22.335+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-POLICY-ACRUNTIME-PARTICIPANT] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms [2023-01-15T23:12:23.386+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 226239 ms [2023-01-15T23:12:23.386+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:23.387+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:23.475+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:23.475+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:23.475+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:23.475+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 216, above threshold 10. [2023-01-15T23:12:24.479+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 227332 ms [2023-01-15T23:12:24.479+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:24.479+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:24.483+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:24.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:24.483+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:24.483+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 217, above threshold 10. [2023-01-15T23:12:25.529+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 228382 ms [2023-01-15T23:12:25.529+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:25.529+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:25.533+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:25.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:25.533+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:25.533+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 218, above threshold 10. [2023-01-15T23:12:26.579+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 229432 ms [2023-01-15T23:12:26.579+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:26.580+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:26.582+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:26.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:26.583+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:26.583+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 219, above threshold 10. [2023-01-15T23:12:27.630+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 230483 ms [2023-01-15T23:12:27.631+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:27.631+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:27.639+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:27.639+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:27.640+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:27.640+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 220, above threshold 10. [2023-01-15T23:12:28.680+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 231533 ms [2023-01-15T23:12:28.680+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:28.681+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:28.684+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:28.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:28.684+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:28.684+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 221, above threshold 10. [2023-01-15T23:12:29.729+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 232582 ms [2023-01-15T23:12:29.729+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:29.730+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:29.733+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:29.734+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:29.735+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:29.735+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 222, above threshold 10. [2023-01-15T23:12:30.779+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 2 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 233632 ms [2023-01-15T23:12:30.779+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:30.779+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:30.782+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:30.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.runAndReset(Unknown Source) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) [2023-01-15T23:12:30.782+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] Send failed, 2 message to send. [2023-01-15T23:12:30.782+00:00|ERROR|CambriaSimplerBatchPublisher|pool-3-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 223, above threshold 10. [2023-01-15T23:12:31.362+00:00|INFO|network|pool-2-thread-1] [OUT|DMAAP|POLICY-ACRUNTIME-PARTICIPANT] {"state":"UNKNOWN","healthStatus":"UNKNOWN","participantStatistics":{"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"},"timeStamp":"2023-01-15T23:12:31.360829Z","state":"UNKNOWN","healthStatus":"UNKNOWN","eventCount":0,"lastExecutionTime":0,"averageExecutionTime":0.0,"upTime":0,"lastEnterTime":0,"lastStart":0},"participantDefinitionUpdates":[],"automationCompositionInfoList":[],"messageType":"PARTICIPANT_STATUS","messageId":"bd54307f-cfae-4057-bb14-894d3875951a","timestamp":"2023-01-15T23:12:31.361009Z","participantType":{"name":"org.onap.policy.clamp.acm.PolicyParticipant","version":"2.3.1"},"participantId":{"name":"org.onap.PM_Policy","version":"1.0.0"}} [2023-01-15T23:12:31.829+00:00|INFO|CambriaSimplerBatchPublisher|pool-3-thread-1] sending 3 msgs to /events/POLICY-ACRUNTIME-PARTICIPANT. Oldest: 234682 ms [2023-01-15T23:12:31.829+00:00|WARN|HostSelector|pool-3-thread-1] All hosts were blacklisted; reverting to full set of hosts. [2023-01-15T23:12:31.829+00:00|INFO|HttpClient|pool-3-thread-1] POST http://message-router:3904/events/POLICY-ACRUNTIME-PARTICIPANT (anonymous) ... [2023-01-15T23:12:31.832+00:00|INFO|HttpClient|pool-3-thread-1] --> HTTP/1.1 503 Service Unavailable [2023-01-15T23:12:31.833+00:00|WARN|CambriaSimplerBatchPublisher|pool-3-thread-1] HTTP/1.1 503 Service Unavailable com.att.nsa.apiClient.http.HttpException: HTTP/1.1 503 Service Unavailable at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:816) at c