14:28:56 Started by timer 14:28:56 Running as SYSTEM 14:28:56 [EnvInject] - Loading node environment variables. 14:28:56 Building remotely on prd-ubuntu1804-docker-8c-8g-12198 (ubuntu1804-docker-8c-8g) in workspace /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres 14:28:56 [ssh-agent] Looking for ssh-agent implementation... 14:28:56 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 14:28:57 $ ssh-agent 14:28:57 SSH_AUTH_SOCK=/tmp/ssh-6gOTyvVWz3yy/agent.2098 14:28:57 SSH_AGENT_PID=2100 14:28:57 [ssh-agent] Started. 14:28:57 Running ssh-add (command line suppressed) 14:28:57 Identity added: /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres@tmp/private_key_17865234717945317612.key (/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres@tmp/private_key_17865234717945317612.key) 14:28:57 [ssh-agent] Using credentials onap-jobbuiler (Gerrit user) 14:28:57 The recommended git tool is: NONE 14:28:58 using credential onap-jenkins-ssh 14:28:58 Wiping out workspace first. 14:28:58 Cloning the remote Git repository 14:28:58 Cloning repository git://cloud.onap.org/mirror/policy/docker.git 14:28:58 > git init /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres # timeout=10 14:28:58 Fetching upstream changes from git://cloud.onap.org/mirror/policy/docker.git 14:28:58 > git --version # timeout=10 14:28:58 > git --version # 'git version 2.17.1' 14:28:58 using GIT_SSH to set credentials Gerrit user 14:28:58 Verifying host key using manually-configured host key entries 14:28:58 > git fetch --tags --progress -- git://cloud.onap.org/mirror/policy/docker.git +refs/heads/*:refs/remotes/origin/* # timeout=30 14:28:59 > git config remote.origin.url git://cloud.onap.org/mirror/policy/docker.git # timeout=10 14:28:59 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 14:28:59 Avoid second fetch 14:28:59 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 14:28:59 Checking out Revision b9d434aeef048c4ea2cf9bd8a27681d375ec5b85 (refs/remotes/origin/master) 14:28:59 > git config core.sparsecheckout # timeout=10 14:28:59 > git checkout -f b9d434aeef048c4ea2cf9bd8a27681d375ec5b85 # timeout=30 14:28:59 Commit message: "Merge "Add kafka docker container for policy CSITs"" 14:28:59 > git rev-list --no-walk b9d434aeef048c4ea2cf9bd8a27681d375ec5b85 # timeout=10 14:29:00 provisioning config files... 14:29:00 copy managed file [npmrc] to file:/home/jenkins/.npmrc 14:29:00 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 14:29:00 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins7064137164808508462.sh 14:29:00 ---> python-tools-install.sh 14:29:00 Setup pyenv: 14:29:00 * system (set by /opt/pyenv/version) 14:29:00 * 3.8.13 (set by /opt/pyenv/version) 14:29:00 * 3.9.13 (set by /opt/pyenv/version) 14:29:00 * 3.10.6 (set by /opt/pyenv/version) 14:29:04 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-jG55 14:29:04 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 14:29:07 lf-activate-venv(): INFO: Installing: lftools 14:29:39 lf-activate-venv(): INFO: Adding /tmp/venv-jG55/bin to PATH 14:29:39 Generating Requirements File 14:30:08 Python 3.10.6 14:30:09 pip 23.3.2 from /tmp/venv-jG55/lib/python3.10/site-packages/pip (python 3.10) 14:30:09 appdirs==1.4.4 14:30:09 argcomplete==3.2.1 14:30:09 aspy.yaml==1.3.0 14:30:09 attrs==23.2.0 14:30:09 autopage==0.5.2 14:30:09 beautifulsoup4==4.12.2 14:30:09 boto3==1.34.19 14:30:09 botocore==1.34.19 14:30:09 bs4==0.0.1 14:30:09 cachetools==5.3.2 14:30:09 certifi==2023.11.17 14:30:09 cffi==1.16.0 14:30:09 cfgv==3.4.0 14:30:09 chardet==5.2.0 14:30:09 charset-normalizer==3.3.2 14:30:09 click==8.1.7 14:30:09 cliff==4.5.0 14:30:09 cmd2==2.4.3 14:30:09 cryptography==3.3.2 14:30:09 debtcollector==2.5.0 14:30:09 decorator==5.1.1 14:30:09 defusedxml==0.7.1 14:30:09 Deprecated==1.2.14 14:30:09 distlib==0.3.8 14:30:09 dnspython==2.4.2 14:30:09 docker==4.2.2 14:30:09 dogpile.cache==1.3.0 14:30:09 email-validator==2.1.0.post1 14:30:09 filelock==3.13.1 14:30:09 future==0.18.3 14:30:09 gitdb==4.0.11 14:30:09 GitPython==3.1.41 14:30:09 google-auth==2.26.2 14:30:09 httplib2==0.22.0 14:30:09 identify==2.5.33 14:30:09 idna==3.6 14:30:09 importlib-resources==1.5.0 14:30:09 iso8601==2.1.0 14:30:09 Jinja2==3.1.3 14:30:09 jmespath==1.0.1 14:30:09 jsonpatch==1.33 14:30:09 jsonpointer==2.4 14:30:09 jsonschema==4.20.0 14:30:09 jsonschema-specifications==2023.12.1 14:30:09 keystoneauth1==5.5.0 14:30:09 kubernetes==29.0.0 14:30:09 lftools==0.37.8 14:30:09 lxml==5.1.0 14:30:09 MarkupSafe==2.1.3 14:30:09 msgpack==1.0.7 14:30:09 multi_key_dict==2.0.3 14:30:09 munch==4.0.0 14:30:09 netaddr==0.10.1 14:30:09 netifaces==0.11.0 14:30:09 niet==1.4.2 14:30:09 nodeenv==1.8.0 14:30:09 oauth2client==4.1.3 14:30:09 oauthlib==3.2.2 14:30:09 openstacksdk==0.62.0 14:30:09 os-client-config==2.1.0 14:30:09 os-service-types==1.7.0 14:30:09 osc-lib==3.0.0 14:30:09 oslo.config==9.3.0 14:30:09 oslo.context==5.3.0 14:30:09 oslo.i18n==6.2.0 14:30:09 oslo.log==5.4.0 14:30:09 oslo.serialization==5.3.0 14:30:09 oslo.utils==6.3.0 14:30:09 packaging==23.2 14:30:09 pbr==6.0.0 14:30:09 platformdirs==4.1.0 14:30:09 prettytable==3.9.0 14:30:09 pyasn1==0.5.1 14:30:09 pyasn1-modules==0.3.0 14:30:09 pycparser==2.21 14:30:09 pygerrit2==2.0.15 14:30:09 PyGithub==2.1.1 14:30:09 pyinotify==0.9.6 14:30:09 PyJWT==2.8.0 14:30:09 PyNaCl==1.5.0 14:30:09 pyparsing==2.4.7 14:30:09 pyperclip==1.8.2 14:30:09 pyrsistent==0.20.0 14:30:09 python-cinderclient==9.4.0 14:30:09 python-dateutil==2.8.2 14:30:09 python-heatclient==3.4.0 14:30:09 python-jenkins==1.8.2 14:30:09 python-keystoneclient==5.3.0 14:30:09 python-magnumclient==4.3.0 14:30:09 python-novaclient==18.4.0 14:30:09 python-openstackclient==6.0.0 14:30:09 python-swiftclient==4.4.0 14:30:09 pytz==2023.3.post1 14:30:09 PyYAML==6.0.1 14:30:09 referencing==0.32.1 14:30:09 requests==2.31.0 14:30:09 requests-oauthlib==1.3.1 14:30:09 requestsexceptions==1.4.0 14:30:09 rfc3986==2.0.0 14:30:09 rpds-py==0.17.1 14:30:09 rsa==4.9 14:30:09 ruamel.yaml==0.18.5 14:30:09 ruamel.yaml.clib==0.2.8 14:30:09 s3transfer==0.10.0 14:30:09 simplejson==3.19.2 14:30:09 six==1.16.0 14:30:09 smmap==5.0.1 14:30:09 soupsieve==2.5 14:30:09 stevedore==5.1.0 14:30:09 tabulate==0.9.0 14:30:09 toml==0.10.2 14:30:09 tomlkit==0.12.3 14:30:09 tqdm==4.66.1 14:30:09 typing_extensions==4.9.0 14:30:09 tzdata==2023.4 14:30:09 urllib3==1.26.18 14:30:09 virtualenv==20.25.0 14:30:09 wcwidth==0.2.13 14:30:09 websocket-client==1.7.0 14:30:09 wrapt==1.16.0 14:30:09 xdg==6.0.0 14:30:09 xmltodict==0.13.0 14:30:09 yq==3.2.3 14:30:09 [EnvInject] - Injecting environment variables from a build step. 14:30:09 [EnvInject] - Injecting as environment variables the properties content 14:30:09 SET_JDK_VERSION=openjdk17 14:30:09 GIT_URL="git://cloud.onap.org/mirror" 14:30:09 14:30:09 [EnvInject] - Variables injected successfully. 14:30:09 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/sh /tmp/jenkins7820274400501342346.sh 14:30:09 ---> update-java-alternatives.sh 14:30:09 ---> Updating Java version 14:30:10 ---> Ubuntu/Debian system detected 14:30:10 update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/bin/java to provide /usr/bin/java (java) in manual mode 14:30:10 update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64/bin/javac to provide /usr/bin/javac (javac) in manual mode 14:30:10 update-alternatives: using /usr/lib/jvm/java-17-openjdk-amd64 to provide /usr/lib/jvm/java-openjdk (java_sdk_openjdk) in manual mode 14:30:10 openjdk version "17.0.4" 2022-07-19 14:30:10 OpenJDK Runtime Environment (build 17.0.4+8-Ubuntu-118.04) 14:30:10 OpenJDK 64-Bit Server VM (build 17.0.4+8-Ubuntu-118.04, mixed mode, sharing) 14:30:10 JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 14:30:10 [EnvInject] - Injecting environment variables from a build step. 14:30:10 [EnvInject] - Injecting as environment variables the properties file path '/tmp/java.env' 14:30:10 [EnvInject] - Variables injected successfully. 14:30:10 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/sh -xe /tmp/jenkins11853234682682919997.sh 14:30:10 + /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/run-project-csit.sh apex-pdp-postgres 14:30:10 + set +u 14:30:10 + save_set 14:30:10 + RUN_CSIT_SAVE_SET=ehxB 14:30:10 + RUN_CSIT_SHELLOPTS=braceexpand:errexit:hashall:interactive-comments:pipefail:xtrace 14:30:10 + '[' 1 -eq 0 ']' 14:30:10 + '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:30:10 + export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:10 + PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:10 + export SCRIPTS=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts 14:30:10 + SCRIPTS=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts 14:30:10 + export ROBOT_VARIABLES= 14:30:10 + ROBOT_VARIABLES= 14:30:10 + export PROJECT=apex-pdp-postgres 14:30:10 + PROJECT=apex-pdp-postgres 14:30:10 + cd /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres 14:30:10 + rm -rf /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/archives/apex-pdp-postgres 14:30:10 + mkdir -p /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/archives/apex-pdp-postgres 14:30:10 + source_safely /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/prepare-robot-env.sh 14:30:10 + '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/prepare-robot-env.sh ']' 14:30:10 + relax_set 14:30:10 + set +e 14:30:10 + set +o pipefail 14:30:10 + . /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/prepare-robot-env.sh 14:30:10 ++ '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:30:10 +++ mktemp -d 14:30:10 ++ ROBOT_VENV=/tmp/tmp.XF4oNdXbEf 14:30:10 ++ echo ROBOT_VENV=/tmp/tmp.XF4oNdXbEf 14:30:10 +++ python3 --version 14:30:10 ++ echo 'Python version is: Python 3.6.9' 14:30:10 Python version is: Python 3.6.9 14:30:10 ++ python3 -m venv --clear /tmp/tmp.XF4oNdXbEf 14:30:11 ++ source /tmp/tmp.XF4oNdXbEf/bin/activate 14:30:11 +++ deactivate nondestructive 14:30:11 +++ '[' -n '' ']' 14:30:11 +++ '[' -n '' ']' 14:30:11 +++ '[' -n /bin/bash -o -n '' ']' 14:30:11 +++ hash -r 14:30:11 +++ '[' -n '' ']' 14:30:11 +++ unset VIRTUAL_ENV 14:30:11 +++ '[' '!' nondestructive = nondestructive ']' 14:30:11 +++ VIRTUAL_ENV=/tmp/tmp.XF4oNdXbEf 14:30:11 +++ export VIRTUAL_ENV 14:30:11 +++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:11 +++ PATH=/tmp/tmp.XF4oNdXbEf/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:11 +++ export PATH 14:30:11 +++ '[' -n '' ']' 14:30:11 +++ '[' -z '' ']' 14:30:11 +++ _OLD_VIRTUAL_PS1= 14:30:11 +++ '[' 'x(tmp.XF4oNdXbEf) ' '!=' x ']' 14:30:11 +++ PS1='(tmp.XF4oNdXbEf) ' 14:30:11 +++ export PS1 14:30:11 +++ '[' -n /bin/bash -o -n '' ']' 14:30:11 +++ hash -r 14:30:11 ++ set -exu 14:30:11 ++ python3 -m pip install -qq --upgrade 'pip<=23.0' 'setuptools<=66.1.1' 14:30:15 ++ echo 'Installing Python Requirements' 14:30:15 Installing Python Requirements 14:30:15 ++ python3 -m pip install -qq -r /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/pylibs.txt 14:30:34 ++ python3 -m pip -qq freeze 14:30:35 bcrypt==4.0.1 14:30:35 beautifulsoup4==4.12.2 14:30:35 bitarray==2.9.2 14:30:35 certifi==2023.11.17 14:30:35 cffi==1.15.1 14:30:35 charset-normalizer==2.0.12 14:30:35 cryptography==40.0.2 14:30:35 decorator==5.1.1 14:30:35 elasticsearch==7.17.9 14:30:35 elasticsearch-dsl==7.4.1 14:30:35 enum34==1.1.10 14:30:35 idna==3.6 14:30:35 importlib-resources==5.4.0 14:30:35 ipaddr==2.2.0 14:30:35 isodate==0.6.1 14:30:35 jmespath==0.10.0 14:30:35 jsonpatch==1.32 14:30:35 jsonpath-rw==1.4.0 14:30:35 jsonpointer==2.3 14:30:35 lxml==5.1.0 14:30:35 netaddr==0.8.0 14:30:35 netifaces==0.11.0 14:30:35 odltools==0.1.28 14:30:35 paramiko==3.4.0 14:30:35 pkg_resources==0.0.0 14:30:35 ply==3.11 14:30:35 pyang==2.6.0 14:30:35 pyangbind==0.8.1 14:30:35 pycparser==2.21 14:30:35 pyhocon==0.3.60 14:30:35 PyNaCl==1.5.0 14:30:35 pyparsing==3.1.1 14:30:35 python-dateutil==2.8.2 14:30:35 regex==2023.8.8 14:30:35 requests==2.27.1 14:30:35 robotframework==6.1.1 14:30:35 robotframework-httplibrary==0.4.2 14:30:35 robotframework-pythonlibcore==3.0.0 14:30:35 robotframework-requests==0.9.4 14:30:35 robotframework-selenium2library==3.0.0 14:30:35 robotframework-seleniumlibrary==5.1.3 14:30:35 robotframework-sshlibrary==3.8.0 14:30:35 scapy==2.5.0 14:30:35 scp==0.14.5 14:30:35 selenium==3.141.0 14:30:35 six==1.16.0 14:30:35 soupsieve==2.3.2.post1 14:30:35 urllib3==1.26.18 14:30:35 waitress==2.0.0 14:30:35 WebOb==1.8.7 14:30:35 WebTest==3.0.0 14:30:35 zipp==3.6.0 14:30:35 ++ mkdir -p /tmp/tmp.XF4oNdXbEf/src/onap 14:30:35 ++ rm -rf /tmp/tmp.XF4oNdXbEf/src/onap/testsuite 14:30:35 ++ python3 -m pip install -qq --upgrade --extra-index-url=https://nexus3.onap.org/repository/PyPi.staging/simple 'robotframework-onap==0.6.0.*' --pre 14:30:41 ++ echo 'Installing python confluent-kafka library' 14:30:41 Installing python confluent-kafka library 14:30:41 ++ python3 -m pip install -qq confluent-kafka 14:30:42 ++ echo 'Uninstall docker-py and reinstall docker.' 14:30:42 Uninstall docker-py and reinstall docker. 14:30:42 ++ python3 -m pip uninstall -y -qq docker 14:30:42 ++ python3 -m pip install -U -qq docker 14:30:43 ++ python3 -m pip -qq freeze 14:30:44 bcrypt==4.0.1 14:30:44 beautifulsoup4==4.12.2 14:30:44 bitarray==2.9.2 14:30:44 certifi==2023.11.17 14:30:44 cffi==1.15.1 14:30:44 charset-normalizer==2.0.12 14:30:44 confluent-kafka==2.3.0 14:30:44 cryptography==40.0.2 14:30:44 decorator==5.1.1 14:30:44 deepdiff==5.7.0 14:30:44 dnspython==2.2.1 14:30:44 docker==5.0.3 14:30:44 elasticsearch==7.17.9 14:30:44 elasticsearch-dsl==7.4.1 14:30:44 enum34==1.1.10 14:30:44 future==0.18.3 14:30:44 idna==3.6 14:30:44 importlib-resources==5.4.0 14:30:44 ipaddr==2.2.0 14:30:44 isodate==0.6.1 14:30:44 Jinja2==3.0.3 14:30:44 jmespath==0.10.0 14:30:44 jsonpatch==1.32 14:30:44 jsonpath-rw==1.4.0 14:30:44 jsonpointer==2.3 14:30:44 kafka-python==2.0.2 14:30:44 lxml==5.1.0 14:30:44 MarkupSafe==2.0.1 14:30:44 more-itertools==5.0.0 14:30:44 netaddr==0.8.0 14:30:44 netifaces==0.11.0 14:30:44 odltools==0.1.28 14:30:44 ordered-set==4.0.2 14:30:44 paramiko==3.4.0 14:30:44 pbr==6.0.0 14:30:44 pkg_resources==0.0.0 14:30:44 ply==3.11 14:30:44 protobuf==3.19.6 14:30:44 pyang==2.6.0 14:30:44 pyangbind==0.8.1 14:30:44 pycparser==2.21 14:30:44 pyhocon==0.3.60 14:30:44 PyNaCl==1.5.0 14:30:44 pyparsing==3.1.1 14:30:44 python-dateutil==2.8.2 14:30:44 PyYAML==6.0.1 14:30:44 regex==2023.8.8 14:30:44 requests==2.27.1 14:30:44 robotframework==6.1.1 14:30:44 robotframework-httplibrary==0.4.2 14:30:44 robotframework-onap==0.6.0.dev105 14:30:44 robotframework-pythonlibcore==3.0.0 14:30:44 robotframework-requests==0.9.4 14:30:44 robotframework-selenium2library==3.0.0 14:30:44 robotframework-seleniumlibrary==5.1.3 14:30:44 robotframework-sshlibrary==3.8.0 14:30:44 robotlibcore-temp==1.0.2 14:30:44 scapy==2.5.0 14:30:44 scp==0.14.5 14:30:44 selenium==3.141.0 14:30:44 six==1.16.0 14:30:44 soupsieve==2.3.2.post1 14:30:44 urllib3==1.26.18 14:30:44 waitress==2.0.0 14:30:44 WebOb==1.8.7 14:30:44 websocket-client==1.3.1 14:30:44 WebTest==3.0.0 14:30:44 zipp==3.6.0 14:30:44 ++ uname 14:30:44 ++ grep -q Linux 14:30:44 ++ sudo apt-get -y -qq install libxml2-utils 14:30:44 + load_set 14:30:44 + _setopts=ehuxB 14:30:44 ++ echo braceexpand:hashall:interactive-comments:nounset:xtrace 14:30:44 ++ tr : ' ' 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o braceexpand 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o hashall 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o interactive-comments 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o nounset 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o xtrace 14:30:44 ++ echo ehuxB 14:30:44 ++ sed 's/./& /g' 14:30:44 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:30:44 + set +e 14:30:44 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:30:44 + set +h 14:30:44 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:30:44 + set +u 14:30:44 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:30:44 + set +x 14:30:44 + source_safely /tmp/tmp.XF4oNdXbEf/bin/activate 14:30:44 + '[' -z /tmp/tmp.XF4oNdXbEf/bin/activate ']' 14:30:44 + relax_set 14:30:44 + set +e 14:30:44 + set +o pipefail 14:30:44 + . /tmp/tmp.XF4oNdXbEf/bin/activate 14:30:44 ++ deactivate nondestructive 14:30:44 ++ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin ']' 14:30:44 ++ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:44 ++ export PATH 14:30:44 ++ unset _OLD_VIRTUAL_PATH 14:30:44 ++ '[' -n '' ']' 14:30:44 ++ '[' -n /bin/bash -o -n '' ']' 14:30:44 ++ hash -r 14:30:44 ++ '[' -n '' ']' 14:30:44 ++ unset VIRTUAL_ENV 14:30:44 ++ '[' '!' nondestructive = nondestructive ']' 14:30:44 ++ VIRTUAL_ENV=/tmp/tmp.XF4oNdXbEf 14:30:44 ++ export VIRTUAL_ENV 14:30:44 ++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:44 ++ PATH=/tmp/tmp.XF4oNdXbEf/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/scripts:/bin 14:30:44 ++ export PATH 14:30:44 ++ '[' -n '' ']' 14:30:44 ++ '[' -z '' ']' 14:30:44 ++ _OLD_VIRTUAL_PS1='(tmp.XF4oNdXbEf) ' 14:30:44 ++ '[' 'x(tmp.XF4oNdXbEf) ' '!=' x ']' 14:30:44 ++ PS1='(tmp.XF4oNdXbEf) (tmp.XF4oNdXbEf) ' 14:30:44 ++ export PS1 14:30:44 ++ '[' -n /bin/bash -o -n '' ']' 14:30:44 ++ hash -r 14:30:44 + load_set 14:30:44 + _setopts=hxB 14:30:44 ++ echo braceexpand:hashall:interactive-comments:xtrace 14:30:44 ++ tr : ' ' 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o braceexpand 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o hashall 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o interactive-comments 14:30:44 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:30:44 + set +o xtrace 14:30:44 ++ echo hxB 14:30:44 ++ sed 's/./& /g' 14:30:44 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:30:44 + set +h 14:30:44 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:30:44 + set +x 14:30:44 + export TEST_PLAN_DIR=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests 14:30:44 + TEST_PLAN_DIR=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests 14:30:44 + export TEST_OPTIONS= 14:30:44 + TEST_OPTIONS= 14:30:44 ++ mktemp -d 14:30:44 + WORKDIR=/tmp/tmp.BrktwiWmQ3 14:30:44 + cd /tmp/tmp.BrktwiWmQ3 14:30:44 + docker login -u docker -p docker nexus3.onap.org:10001 14:30:44 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 14:30:45 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 14:30:45 Configure a credential helper to remove this warning. See 14:30:45 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 14:30:45 14:30:45 Login Succeeded 14:30:45 + SETUP=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh 14:30:45 + '[' -f /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh ']' 14:30:45 + echo 'Running setup script /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh' 14:30:45 Running setup script /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh 14:30:45 + source_safely /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh 14:30:45 + '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh ']' 14:30:45 + relax_set 14:30:45 + set +e 14:30:45 + set +o pipefail 14:30:45 + . /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/setup-apex-pdp-postgres.sh 14:30:45 ++ source /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/node-templates.sh 14:30:45 +++ '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:30:45 ++++ awk -F= '$1 == "defaultbranch" { print $2 }' /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/.gitreview 14:30:45 +++ GERRIT_BRANCH=master 14:30:45 +++ echo GERRIT_BRANCH=master 14:30:45 GERRIT_BRANCH=master 14:30:45 +++ rm -rf /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models 14:30:45 +++ mkdir /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models 14:30:45 +++ git clone -b master --single-branch https://github.com/onap/policy-models.git /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models 14:30:45 Cloning into '/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models'... 14:30:46 +++ export DATA=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies 14:30:46 +++ DATA=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies 14:30:46 +++ export NODETEMPLATES=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/nodetemplates 14:30:46 +++ NODETEMPLATES=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/nodetemplates 14:30:46 +++ sed -e 's!Measurement_vGMUX!ADifferentValue!' /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies/vCPE.policy.monitoring.input.tosca.json 14:30:46 +++ sed -e 's!"version": "1.0.0"!"version": "2.0.0"!' -e 's!"policy-version": 1!"policy-version": 2!' /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies/vCPE.policy.monitoring.input.tosca.json 14:30:46 ++ source /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose/start-postgres-tests.sh 1 14:30:46 +++ '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:30:46 +++ COMPOSE_FOLDER=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose 14:30:46 +++ cd /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose 14:30:46 +++ echo 'Configuring docker compose...' 14:30:46 Configuring docker compose... 14:30:46 +++ source export-ports.sh 14:30:46 +++ source get-versions.sh 14:30:48 +++ export REPLICAS=1 14:30:48 +++ REPLICAS=1 14:30:48 +++ docker-compose -f docker-compose.postgres.yml up -d apex-pdp prometheus 14:30:49 Creating network "compose_default" with the default driver 14:30:49 Pulling postgres (nexus3.onap.org:10001/library/postgres:11.1)... 14:30:49 11.1: Pulling from library/postgres 14:30:54 Digest: sha256:f310592cf3964f038dbaefac2dc2088982e5ab06312a590bcacc97749ee5db69 14:30:54 Status: Downloaded newer image for nexus3.onap.org:10001/library/postgres:11.1 14:30:54 Pulling simulator (nexus3.onap.org:10001/onap/policy-models-simulator:3.1.1-SNAPSHOT)... 14:30:54 3.1.1-SNAPSHOT: Pulling from onap/policy-models-simulator 14:30:58 Digest: sha256:09b9abb94ede918d748d5f6ffece2e7592c9941527c37f3d00df286ee158ae05 14:30:58 Status: Downloaded newer image for nexus3.onap.org:10001/onap/policy-models-simulator:3.1.1-SNAPSHOT 14:30:58 Pulling policy-db-migrator (nexus3.onap.org:10001/onap/policy-db-migrator:3.1.1-SNAPSHOT)... 14:30:58 3.1.1-SNAPSHOT: Pulling from onap/policy-db-migrator 14:31:00 Digest: sha256:bd33796bedd5ad2337f9468b0cd9d04db279a1f831716e1c03cebe5a20ced20b 14:31:00 Status: Downloaded newer image for nexus3.onap.org:10001/onap/policy-db-migrator:3.1.1-SNAPSHOT 14:31:00 Pulling api (nexus3.onap.org:10001/onap/policy-api:3.1.0)... 14:31:00 3.1.0: Pulling from onap/policy-api 14:31:04 Digest: sha256:5c4c03761af8683035bdfb23ad490044d6b151e5d5939a59b93a6064a761dbbd 14:31:04 Status: Downloaded newer image for nexus3.onap.org:10001/onap/policy-api:3.1.0 14:31:04 Pulling pap (nexus3.onap.org:10001/onap/policy-pap:3.1.1-SNAPSHOT)... 14:31:04 3.1.1-SNAPSHOT: Pulling from onap/policy-pap 14:31:07 Digest: sha256:37c4361d99c3f559835790653cd75fd194587e3e5951cbeb5086d1c0b8af6b74 14:31:07 Status: Downloaded newer image for nexus3.onap.org:10001/onap/policy-pap:3.1.1-SNAPSHOT 14:31:07 Pulling apex-pdp (nexus3.onap.org:10001/onap/policy-apex-pdp:3.1.1-SNAPSHOT)... 14:31:07 3.1.1-SNAPSHOT: Pulling from onap/policy-apex-pdp 14:31:13 Digest: sha256:0fdae8f3a73915cdeb896f38ac7d5b74e658832fd10929dcf3fe68219098b89b 14:31:13 Status: Downloaded newer image for nexus3.onap.org:10001/onap/policy-apex-pdp:3.1.1-SNAPSHOT 14:31:13 Pulling prometheus (nexus3.onap.org:10001/prom/prometheus:latest)... 14:31:13 latest: Pulling from prom/prometheus 14:31:16 Digest: sha256:a67e5e402ff5410b86ec48b39eab1a3c4df2a7e78a71bf025ec5e32e09090ad4 14:31:16 Status: Downloaded newer image for nexus3.onap.org:10001/prom/prometheus:latest 14:31:16 Creating postgres ... 14:31:16 Creating prometheus ... 14:31:16 Creating simulator ... 14:31:33 Creating prometheus ... done 14:31:34 Creating postgres ... done 14:31:34 Creating policy-db-migrator ... 14:31:35 Creating policy-db-migrator ... done 14:31:35 Creating policy-api ... 14:31:36 Creating policy-api ... done 14:31:37 Creating simulator ... done 14:31:37 Creating policy-pap ... 14:31:38 Creating policy-pap ... done 14:31:38 Creating policy-apex-pdp ... 14:31:39 Creating policy-apex-pdp ... done 14:31:40 +++ cd /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres 14:31:40 ++ sleep 10 14:31:50 ++ unset http_proxy https_proxy 14:31:50 ++ bash /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/wait_for_rest.sh localhost 30003 14:31:50 Waiting for REST to come up on localhost port 30003... 14:31:50 NAMES STATUS 14:31:50 policy-apex-pdp Up 10 seconds 14:31:50 policy-pap Up 11 seconds 14:31:50 policy-api Up 13 seconds 14:31:50 prometheus Up 16 seconds 14:31:50 postgres Up 15 seconds 14:31:55 NAMES STATUS 14:31:55 policy-apex-pdp Up 15 seconds 14:31:55 policy-pap Up 16 seconds 14:31:55 policy-api Up 18 seconds 14:31:55 prometheus Up 21 seconds 14:31:55 postgres Up 20 seconds 14:32:00 NAMES STATUS 14:32:00 policy-apex-pdp Up 20 seconds 14:32:00 policy-pap Up 21 seconds 14:32:00 policy-api Up 23 seconds 14:32:00 prometheus Up 26 seconds 14:32:00 postgres Up 25 seconds 14:32:05 NAMES STATUS 14:32:05 policy-apex-pdp Up 25 seconds 14:32:05 policy-pap Up 26 seconds 14:32:05 policy-api Up 28 seconds 14:32:05 prometheus Up 31 seconds 14:32:05 postgres Up 30 seconds 14:32:10 NAMES STATUS 14:32:10 policy-apex-pdp Up 30 seconds 14:32:10 policy-pap Up 31 seconds 14:32:10 policy-api Up 33 seconds 14:32:10 prometheus Up 36 seconds 14:32:10 postgres Up 35 seconds 14:32:10 ++ bash /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/scripts/wait_for_rest.sh localhost 30001 14:32:10 Waiting for REST to come up on localhost port 30001... 14:32:10 NAMES STATUS 14:32:10 policy-apex-pdp Up 30 seconds 14:32:10 policy-pap Up 31 seconds 14:32:10 policy-api Up 33 seconds 14:32:10 prometheus Up 36 seconds 14:32:10 postgres Up 35 seconds 14:32:10 ++ sleep 20 14:32:30 ++ healthy=false 14:32:30 ++ '[' false = false ']' 14:32:30 +++ curl -s -k --user 'policyadmin:zb!XztG34' http://localhost:30001/policy/apex-pdp/v1/healthcheck 14:32:30 ++ msg='{"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","url":"self","healthy":true,"code":200,"message":"alive"}' 14:32:30 ++ echo '{"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","url":"self","healthy":true,"code":200,"message":"alive"}' 14:32:30 ++ grep -q true 14:32:30 ++ '[' 0 -eq 0 ']' 14:32:30 ++ healthy=true 14:32:30 ++ break 14:32:30 ++ export DMAAP_IP=localhost:30904 14:32:30 ++ DMAAP_IP=localhost:30904 14:32:30 ++ export SUITES=apex-pdp-test.robot 14:32:30 ++ SUITES=apex-pdp-test.robot 14:32:30 ++ ROBOT_VARIABLES='-v POLICY_PAP_IP:localhost:30003 -v POLICY_API_IP:localhost:30002 14:32:30 -v PROMETHEUS_IP:localhost:30259 -v DATA:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies -v NODETEMPLATES:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/nodetemplates 14:32:30 -v APEX_IP:localhost:30001 -v DMAAP_IP:localhost:30904 14:32:30 -v APEX_EVENTS_IP:localhost:23324' 14:32:30 + load_set 14:32:30 + _setopts=hxB 14:32:30 ++ echo braceexpand:hashall:interactive-comments:xtrace 14:32:30 ++ tr : ' ' 14:32:30 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:32:30 + set +o braceexpand 14:32:30 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:32:30 + set +o hashall 14:32:30 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:32:30 + set +o interactive-comments 14:32:30 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:32:30 + set +o xtrace 14:32:30 ++ echo hxB 14:32:30 ++ sed 's/./& /g' 14:32:30 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:32:30 + set +h 14:32:30 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:32:30 + set +x 14:32:30 + docker_stats 14:32:30 + tee /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/archives/apex-pdp-postgres/_sysinfo-1-after-setup.txt 14:32:30 ++ uname -s 14:32:30 + '[' Linux == Darwin ']' 14:32:30 + sh -c 'top -bn1 | head -3' 14:32:30 top - 14:32:30 up 4 min, 0 users, load average: 2.07, 1.09, 0.44 14:32:30 Tasks: 216 total, 1 running, 138 sleeping, 0 stopped, 0 zombie 14:32:30 %Cpu(s): 12.1 us, 2.3 sy, 0.0 ni, 82.2 id, 3.3 wa, 0.0 hi, 0.1 si, 0.0 st 14:32:30 + echo 14:32:30 + sh -c 'free -h' 14:32:30 14:32:30 total used free shared buff/cache available 14:32:30 Mem: 31G 2.0G 24G 17M 4.8G 28G 14:32:30 Swap: 1.0G 0B 1.0G 14:32:30 + echo 14:32:30 14:32:30 + docker ps --format 'table {{ .Names }}\t{{ .Status }}' 14:32:30 NAMES STATUS 14:32:30 policy-apex-pdp Up 50 seconds 14:32:30 policy-pap Up 51 seconds 14:32:30 policy-api Up 53 seconds 14:32:30 prometheus Up 56 seconds 14:32:30 postgres Up 55 seconds 14:32:30 + echo 14:32:30 + docker stats --no-stream 14:32:30 14:32:33 CONTAINER ID NAME CPU % MEM USAGE / LIMIT MEM % NET I/O BLOCK I/O PIDS 14:32:33 00e230bee38e policy-apex-pdp 2.81% 153.2MiB / 31.41GiB 0.48% 4.47kB / 4.88kB 0B / 0B 48 14:32:33 15841a02519d policy-pap 0.87% 502.8MiB / 31.41GiB 1.56% 22.8kB / 32.3kB 0B / 181MB 61 14:32:33 85a511b42cda policy-api 0.43% 545.2MiB / 31.41GiB 1.70% 1.19MB / 1.04MB 0B / 0B 56 14:32:33 486cc70152bb prometheus 0.00% 18.8MiB / 31.41GiB 0.06% 1.96kB / 474B 4.1kB / 0B 13 14:32:33 c9d4bd4ab27a postgres 0.03% 74.35MiB / 31.41GiB 0.23% 1.43MB / 1.44MB 225kB / 91.9MB 27 14:32:33 + echo 14:32:33 14:32:33 + cd /tmp/tmp.BrktwiWmQ3 14:32:33 + echo 'Reading the testplan:' 14:32:33 Reading the testplan: 14:32:33 + echo apex-pdp-test.robot 14:32:33 + egrep -v '(^[[:space:]]*#|^[[:space:]]*$)' 14:32:33 + sed 's|^|/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests/|' 14:32:33 + cat testplan.txt 14:32:33 /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests/apex-pdp-test.robot 14:32:33 ++ xargs 14:32:33 + SUITES=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests/apex-pdp-test.robot 14:32:33 + echo 'ROBOT_VARIABLES=-v POLICY_PAP_IP:localhost:30003 -v POLICY_API_IP:localhost:30002 14:32:33 -v PROMETHEUS_IP:localhost:30259 -v DATA:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies -v NODETEMPLATES:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/nodetemplates 14:32:33 -v APEX_IP:localhost:30001 -v DMAAP_IP:localhost:30904 14:32:33 -v APEX_EVENTS_IP:localhost:23324' 14:32:33 ROBOT_VARIABLES=-v POLICY_PAP_IP:localhost:30003 -v POLICY_API_IP:localhost:30002 14:32:33 -v PROMETHEUS_IP:localhost:30259 -v DATA:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies -v NODETEMPLATES:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/nodetemplates 14:32:33 -v APEX_IP:localhost:30001 -v DMAAP_IP:localhost:30904 14:32:33 -v APEX_EVENTS_IP:localhost:23324 14:32:33 + echo 'Starting Robot test suites /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests/apex-pdp-test.robot ...' 14:32:33 Starting Robot test suites /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests/apex-pdp-test.robot ... 14:32:33 + relax_set 14:32:33 + set +e 14:32:33 + set +o pipefail 14:32:33 + python3 -m robot.run -N apex-pdp-postgres -v WORKSPACE:/tmp -v POLICY_PAP_IP:localhost:30003 -v POLICY_API_IP:localhost:30002 -v PROMETHEUS_IP:localhost:30259 -v DATA:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/policies -v NODETEMPLATES:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models/models-examples/src/main/resources/nodetemplates -v APEX_IP:localhost:30001 -v DMAAP_IP:localhost:30904 -v APEX_EVENTS_IP:localhost:23324 /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/resources/tests/apex-pdp-test.robot 14:32:33 ============================================================================== 14:32:33 apex-pdp-postgres 14:32:33 ============================================================================== 14:32:33 Healthcheck :: Runs Apex PDP Health check | PASS | 14:32:33 ------------------------------------------------------------------------------ 14:34:38 ExecuteApexSampleDomainPolicy | FAIL | 14:34:38 Keyword 'QueryPolicyStatus' failed after retrying for 2 minutes. The last error was: Resolving variable '${responseEntry['pdpGroup']}' failed: Variable '${responseEntry}' not found. 14:34:38 ------------------------------------------------------------------------------ 14:36:42 ExecuteApexTestPnfPolicy | FAIL | 14:36:42 Keyword 'QueryPolicyStatus' failed after retrying for 2 minutes. The last error was: Resolving variable '${responseEntry['pdpGroup']}' failed: Variable '${responseEntry}' not found. 14:36:42 ------------------------------------------------------------------------------ 14:38:45 ExecuteApexTestVnfPolicy | FAIL | 14:38:45 Keyword 'QueryPolicyStatus' failed after retrying for 2 minutes. The last error was: Resolving variable '${responseEntry['pdpGroup']}' failed: Variable '${responseEntry}' not found. 14:38:45 ------------------------------------------------------------------------------ 14:40:49 ExecuteApexTestPnfPolicyWithMetadataSet | FAIL | 14:40:49 Keyword 'QueryPolicyStatus' failed after retrying for 2 minutes. The last error was: Resolving variable '${responseEntry['pdpGroup']}' failed: Variable '${responseEntry}' not found. 14:40:49 ------------------------------------------------------------------------------ 14:40:49 Metrics :: Verify policy-apex-pdp is exporting prometheus metrics | FAIL | 14:40:49 '# HELP jvm_classes_currently_loaded The number of classes that are currently loaded in the JVM 14:40:49 # TYPE jvm_classes_currently_loaded gauge 14:40:49 jvm_classes_currently_loaded 6679.0 14:40:49 # HELP jvm_classes_loaded_total The total number of classes that have been loaded since the JVM has started execution 14:40:49 # TYPE jvm_classes_loaded_total counter 14:40:49 jvm_classes_loaded_total 6679.0 14:40:49 # HELP jvm_classes_unloaded_total The total number of classes that have been unloaded since the JVM has started execution 14:40:49 # TYPE jvm_classes_unloaded_total counter 14:40:49 jvm_classes_unloaded_total 0.0 14:40:49 # HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. 14:40:49 # TYPE process_cpu_seconds_total counter 14:40:49 process_cpu_seconds_total 10.72 14:40:49 # HELP process_start_time_seconds Start time of the process since unix epoch in seconds. 14:40:49 # TYPE process_start_time_seconds gauge 14:40:49 process_start_time_seconds 1.705242728062E9 14:40:49 [ Message content over the limit has been removed. ] 14:40:49 jvm_buffer_pool_used_buffers{pool="mapped - 'non-volatile memory'",} 0.0 14:40:49 # HELP jvm_memory_pool_allocated_bytes_created Total bytes allocated in a given JVM memory pool. Only updated after GC, not continuously. 14:40:49 # TYPE jvm_memory_pool_allocated_bytes_created gauge 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="CodeHeap 'profiled nmethods'",} 1.705242729642E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="G1 Old Gen",} 1.705242729645E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="G1 Eden Space",} 1.705242729645E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="CodeHeap 'non-profiled nmethods'",} 1.705242729645E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="G1 Survivor Space",} 1.705242729645E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="Compressed Class Space",} 1.705242729645E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="Metaspace",} 1.705242729645E9 14:40:49 jvm_memory_pool_allocated_bytes_created{pool="CodeHeap 'non-nmethods'",} 1.705242729645E9 14:40:49 ' does not contain 'pdpa_policy_deployments_total{operation="deploy",status="TOTAL",} 4.0' 14:40:49 ------------------------------------------------------------------------------ 14:40:49 apex-pdp-postgres | FAIL | 14:40:49 6 tests, 1 passed, 5 failed 14:40:49 ============================================================================== 14:40:49 Output: /tmp/tmp.BrktwiWmQ3/output.xml 14:40:50 Log: /tmp/tmp.BrktwiWmQ3/log.html 14:40:50 Report: /tmp/tmp.BrktwiWmQ3/report.html 14:40:50 + RESULT=5 14:40:50 + load_set 14:40:50 + _setopts=hxB 14:40:50 ++ echo braceexpand:hashall:interactive-comments:xtrace 14:40:50 ++ tr : ' ' 14:40:50 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:40:50 + set +o braceexpand 14:40:50 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:40:50 + set +o hashall 14:40:50 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:40:50 + set +o interactive-comments 14:40:50 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:40:50 + set +o xtrace 14:40:50 ++ echo hxB 14:40:50 ++ sed 's/./& /g' 14:40:50 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:40:50 + set +h 14:40:50 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:40:50 + set +x 14:40:50 + echo 'RESULT: 5' 14:40:50 RESULT: 5 14:40:50 + exit 5 14:40:50 + on_exit 14:40:50 + rc=5 14:40:50 + [[ -n /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ]] 14:40:50 + docker ps --format 'table {{ .Names }}\t{{ .Status }}' 14:40:50 NAMES STATUS 14:40:50 policy-apex-pdp Up 9 minutes 14:40:50 policy-pap Up 9 minutes 14:40:50 policy-api Up 9 minutes 14:40:50 prometheus Up 9 minutes 14:40:50 postgres Up 9 minutes 14:40:50 + docker_stats 14:40:50 ++ uname -s 14:40:50 + '[' Linux == Darwin ']' 14:40:50 + sh -c 'top -bn1 | head -3' 14:40:50 top - 14:40:50 up 12 min, 0 users, load average: 0.06, 0.32, 0.32 14:40:50 Tasks: 200 total, 1 running, 135 sleeping, 0 stopped, 0 zombie 14:40:50 %Cpu(s): 4.9 us, 0.9 sy, 0.0 ni, 92.7 id, 1.4 wa, 0.0 hi, 0.0 si, 0.0 st 14:40:50 + echo 14:40:50 14:40:50 + sh -c 'free -h' 14:40:50 total used free shared buff/cache available 14:40:50 Mem: 31G 2.1G 24G 19M 4.9G 28G 14:40:50 Swap: 1.0G 0B 1.0G 14:40:50 + echo 14:40:50 14:40:50 + docker ps --format 'table {{ .Names }}\t{{ .Status }}' 14:40:50 NAMES STATUS 14:40:50 policy-apex-pdp Up 9 minutes 14:40:50 policy-pap Up 9 minutes 14:40:50 policy-api Up 9 minutes 14:40:50 prometheus Up 9 minutes 14:40:50 postgres Up 9 minutes 14:40:50 + echo 14:40:50 14:40:50 + docker stats --no-stream 14:40:53 CONTAINER ID NAME CPU % MEM USAGE / LIMIT MEM % NET I/O BLOCK I/O PIDS 14:40:53 00e230bee38e policy-apex-pdp 0.25% 204.1MiB / 31.41GiB 0.63% 14.3kB / 109kB 0B / 0B 49 14:40:53 15841a02519d policy-pap 0.34% 519.3MiB / 31.41GiB 1.61% 3.35MB / 1.66MB 0B / 181MB 61 14:40:53 85a511b42cda policy-api 0.08% 549.3MiB / 31.41GiB 1.71% 5.78MB / 3.59MB 0B / 0B 56 14:40:53 486cc70152bb prometheus 0.00% 20.84MiB / 31.41GiB 0.06% 761kB / 28.4kB 4.1kB / 0B 13 14:40:53 c9d4bd4ab27a postgres 0.00% 78.95MiB / 31.41GiB 0.25% 4.44MB / 8.32MB 225kB / 98.1MB 27 14:40:53 + echo 14:40:53 14:40:53 + source_safely /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose/stop-compose.sh 14:40:53 + '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose/stop-compose.sh ']' 14:40:53 + relax_set 14:40:53 + set +e 14:40:53 + set +o pipefail 14:40:53 + . /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose/stop-compose.sh 14:40:53 ++ echo 'Shut down started!' 14:40:53 Shut down started! 14:40:53 ++ '[' -z /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:40:53 ++ COMPOSE_FOLDER=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose 14:40:53 ++ cd /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/compose 14:40:53 ++ source export-ports.sh 14:40:53 ++ source get-versions.sh 14:40:55 ++ echo 'Collecting logs from docker compose containers...' 14:40:55 Collecting logs from docker compose containers... 14:40:55 ++ docker-compose logs 14:40:57 ++ cat docker_compose.log 14:40:57 Attaching to policy-apex-pdp, policy-pap, policy-api, policy-db-migrator, simulator, prometheus 14:40:57 policy-apex-pdp | Waiting for postgres port 5432... 14:40:57 policy-apex-pdp | postgres (172.17.0.2:5432) open 14:40:57 policy-apex-pdp | Waiting for message-router port 3904... 14:40:57 policy-apex-pdp | message-router (172.17.0.4:3904) open 14:40:57 policy-apex-pdp | Waiting for pap port 6969... 14:40:57 policy-apex-pdp | pap (172.17.0.7:6969) open 14:40:57 policy-apex-pdp | apexApps.sh: running application 'onappf' with command 'java -Dlogback.configurationFile=/opt/app/policy/apex-pdp/etc/logback.xml -cp /opt/app/policy/apex-pdp/etc:/opt/app/policy/apex-pdp/etc/hazelcast:/opt/app/policy/apex-pdp/etc/infinispan:/opt/app/policy/apex-pdp/lib/* -Djavax.net.ssl.keyStore=/opt/app/policy/apex-pdp/etc/ssl/policy-keystore -Djavax.net.ssl.keyStorePassword=Pol1cy_0nap -Djavax.net.ssl.trustStore=/opt/app/policy/apex-pdp/etc/ssl/policy-truststore -Djavax.net.ssl.trustStorePassword=Pol1cy_0nap -Dlogback.configurationFile=/opt/app/policy/apex-pdp/etc/logback.xml -Dhazelcast.config=/opt/app/policy/apex-pdp/etc/hazelcast.xml -Dhazelcast.mancenter.enabled=false org.onap.policy.apex.services.onappf.ApexStarterMain -c /opt/app/policy/apex-pdp/etc/onappf/config/OnapPfConfig.json' 14:40:57 policy-apex-pdp | [2024-01-14T14:32:08.671+00:00|INFO|ApexStarterMain|main] In ApexStarter with parameters [-c, /opt/app/policy/apex-pdp/etc/onappf/config/OnapPfConfig.json] 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.140+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.177+00:00|INFO|ServiceManager|main] service manager starting 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.177+00:00|INFO|ServiceManager|main] service manager starting topics 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.184+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.186+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.189+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.186+00:00|INFO|InlineBusTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=53152a22-aee1-4b05-af7d-9a50356ac2ab, alive=false, publisher=null]]: starting 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.195+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.196+00:00|INFO|InlineDmaapTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=53152a22-aee1-4b05-af7d-9a50356ac2ab, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.196+00:00|INFO|ServiceManager|main] service manager starting set alive 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.196+00:00|INFO|ServiceManager|main] service manager starting register pdp status context object 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.199+00:00|INFO|ServiceManager|main] service manager starting topic sinks 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.199+00:00|INFO|ServiceManager|main] service manager starting Pdp Status publisher 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.202+00:00|INFO|ServiceManager|main] service manager starting Register pdp update listener 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.202+00:00|INFO|ServiceManager|main] service manager starting Register pdp state change request dispatcher 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.203+00:00|INFO|ServiceManager|main] service manager starting Message Dispatcher 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.203+00:00|INFO|TopicBase|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@1253e7cb 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.203+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: register: start not attempted 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.203+00:00|INFO|ServiceManager|main] service manager starting Create REST server 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.223+00:00|INFO|OrderedServiceImpl|Timer-0] ***** OrderedServiceImpl implementers: 14:40:57 policy-apex-pdp | [] 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.225+00:00|INFO|network|Timer-0] [OUT|DMAAP|policy-pdp-pap] 14:40:57 policy-apex-pdp | {"pdpType":"apex","state":"PASSIVE","healthy":"HEALTHY","description":"Pdp Heartbeat","messageName":"PDP_STATUS","requestId":"9d15c11c-89d5-4386-82de-1b80a0fc053c","timestampMs":1705242729204,"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","pdpGroup":"defaultGroup"} 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.297+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 66 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.303+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.410+00:00|INFO|ServiceManager|main] service manager starting Rest Server 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.410+00:00|INFO|ServiceManager|main] service manager starting 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.410+00:00|INFO|ServiceManager|main] service manager starting REST RestServerParameters 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.410+00:00|INFO|JettyServletServer|main] JettyJerseyServer [Jerseyservlets={/metrics=io.prometheus.client.servlet.jakarta.exporter.MetricsServlet-6175619b==io.prometheus.client.servlet.jakarta.exporter.MetricsServlet@c4275967{jsp=null,order=-1,inst=false,async=true,src=EMBEDDED:null,STOPPED}, /*=org.glassfish.jersey.servlet.ServletContainer-3d08f3f5==org.glassfish.jersey.servlet.ServletContainer@89f28e43{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=swagger-6969, toString()=JettyServletServer(name=RestServerParameters, host=0.0.0.0, port=6969, sniHostCheck=false, user=policyadmin, password=zb!XztG34, contextPath=/, jettyServer=Server@4cc76301{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@2f08c4b{/,null,STOPPED}, connector=RestServerParameters@61bcd567{HTTP/1.1, (http/1.1)}{0.0.0.0:6969}, jettyThread=null, servlets={/metrics=io.prometheus.client.servlet.jakarta.exporter.MetricsServlet-6175619b==io.prometheus.client.servlet.jakarta.exporter.MetricsServlet@c4275967{jsp=null,order=-1,inst=false,async=true,src=EMBEDDED:null,STOPPED}, /*=org.glassfish.jersey.servlet.ServletContainer-3d08f3f5==org.glassfish.jersey.servlet.ServletContainer@89f28e43{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.420+00:00|INFO|ServiceManager|main] service manager started 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.420+00:00|INFO|ServiceManager|main] service manager started 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.420+00:00|INFO|ApexStarterMain|main] Started policy-apex-pdp service successfully. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.420+00:00|INFO|JettyServletServer|RestServerParameters-6969] JettyJerseyServer [Jerseyservlets={/metrics=io.prometheus.client.servlet.jakarta.exporter.MetricsServlet-6175619b==io.prometheus.client.servlet.jakarta.exporter.MetricsServlet@c4275967{jsp=null,order=-1,inst=false,async=true,src=EMBEDDED:null,STOPPED}, /*=org.glassfish.jersey.servlet.ServletContainer-3d08f3f5==org.glassfish.jersey.servlet.ServletContainer@89f28e43{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=swagger-6969, toString()=JettyServletServer(name=RestServerParameters, host=0.0.0.0, port=6969, sniHostCheck=false, user=policyadmin, password=zb!XztG34, contextPath=/, jettyServer=Server@4cc76301{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@2f08c4b{/,null,STOPPED}, connector=RestServerParameters@61bcd567{HTTP/1.1, (http/1.1)}{0.0.0.0:6969}, jettyThread=Thread[RestServerParameters-6969,5,main], servlets={/metrics=io.prometheus.client.servlet.jakarta.exporter.MetricsServlet-6175619b==io.prometheus.client.servlet.jakarta.exporter.MetricsServlet@c4275967{jsp=null,order=-1,inst=false,async=true,src=EMBEDDED:null,STOPPED}, /*=org.glassfish.jersey.servlet.ServletContainer-3d08f3f5==org.glassfish.jersey.servlet.ServletContainer@89f28e43{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.994+00:00|INFO|GsonMessageBodyHandler|RestServerParameters-6969] Using GSON for REST calls 14:40:57 policy-apex-pdp | [2024-01-14T14:32:09.997+00:00|INFO|YamlMessageBodyHandler|RestServerParameters-6969] Accepting YAML for REST calls 14:40:57 policy-apex-pdp | [2024-01-14T14:32:10.481+00:00|INFO|RequestLog|qtp248710794-31] 172.17.0.1 - - [14/Jan/2024:14:32:10 +0000] "GET / HTTP/1.1" 401 497 "-" "curl/7.58.0" 14:40:57 policy-apex-pdp | [2024-01-14T14:32:14.249+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:14.249+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:14.250+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:14.250+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:14.250+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:14.253+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:15.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 6066 ms 14:40:57 policy-api | Waiting for postgres port 5432... 14:40:57 policy-api | postgres (172.17.0.2:5432) open 14:40:57 policy-api | Waiting for policy-db-migrator port 6824... 14:40:57 policy-api | policy-db-migrator (172.17.0.5:6824) open 14:40:57 policy-api | Policy api config file: /opt/app/policy/api/etc/apiParameters.yaml 14:40:57 policy-api | 14:40:57 policy-api | . ____ _ __ _ _ 14:40:57 policy-api | /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ 14:40:57 policy-api | ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ 14:40:57 policy-api | \\/ ___)| |_)| | | | | || (_| | ) ) ) ) 14:40:57 policy-api | ' |____| .__|_| |_|_| |_\__, | / / / / 14:40:57 policy-api | =========|_|==============|___/=/_/_/_/ 14:40:57 policy-api | :: Spring Boot :: (v3.1.4) 14:40:57 policy-api | 14:40:57 policy-api | [2024-01-14T14:31:44.200+00:00|INFO|PolicyApiApplication|main] Starting PolicyApiApplication using Java 17.0.9 with PID 16 (/app/api.jar started by policy in /opt/app/policy/api/bin) 14:40:57 policy-api | [2024-01-14T14:31:44.202+00:00|INFO|PolicyApiApplication|main] No active profile set, falling back to 1 default profile: "default" 14:40:57 policy-api | [2024-01-14T14:31:46.097+00:00|INFO|RepositoryConfigurationDelegate|main] Bootstrapping Spring Data JPA repositories in DEFAULT mode. 14:40:57 policy-api | [2024-01-14T14:31:46.185+00:00|INFO|RepositoryConfigurationDelegate|main] Finished Spring Data repository scanning in 78 ms. Found 6 JPA repository interfaces. 14:40:57 policy-api | [2024-01-14T14:31:46.591+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.api.main.exception.ServiceExceptionHandler 14:40:57 policy-api | [2024-01-14T14:31:46.592+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.api.main.exception.ServiceExceptionHandler 14:40:57 policy-api | [2024-01-14T14:31:47.288+00:00|INFO|TomcatWebServer|main] Tomcat initialized with port(s): 6969 (http) 14:40:57 policy-api | [2024-01-14T14:31:47.298+00:00|INFO|Http11NioProtocol|main] Initializing ProtocolHandler ["http-nio-6969"] 14:40:57 policy-api | [2024-01-14T14:31:47.299+00:00|INFO|StandardService|main] Starting service [Tomcat] 14:40:57 policy-api | [2024-01-14T14:31:47.300+00:00|INFO|StandardEngine|main] Starting Servlet engine: [Apache Tomcat/10.1.16] 14:40:57 policy-api | [2024-01-14T14:31:47.390+00:00|INFO|[/policy/api/v1]|main] Initializing Spring embedded WebApplicationContext 14:40:57 policy-api | [2024-01-14T14:31:47.390+00:00|INFO|ServletWebServerApplicationContext|main] Root WebApplicationContext: initialization completed in 3126 ms 14:40:57 policy-api | [2024-01-14T14:31:47.799+00:00|INFO|LogHelper|main] HHH000204: Processing PersistenceUnitInfo [name: default] 14:40:57 policy-api | [2024-01-14T14:31:47.878+00:00|INFO|Version|main] HHH000412: Hibernate ORM core version 6.3.0.CR1 14:40:57 policy-api | [2024-01-14T14:31:47.881+00:00|INFO|Environment|main] HHH000406: Using bytecode reflection optimizer 14:40:57 policy-api | [2024-01-14T14:31:47.928+00:00|INFO|RegionFactoryInitiator|main] HHH000026: Second-level cache disabled 14:40:57 policy-api | [2024-01-14T14:31:48.257+00:00|INFO|SpringPersistenceUnitInfo|main] No LoadTimeWeaver setup: ignoring JPA class transformer 14:40:57 policy-api | [2024-01-14T14:31:48.277+00:00|INFO|HikariDataSource|main] HikariPool-1 - Starting... 14:40:57 policy-api | [2024-01-14T14:31:48.379+00:00|INFO|HikariPool|main] HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@1bc776b7 14:40:57 policy-api | [2024-01-14T14:31:48.381+00:00|INFO|HikariDataSource|main] HikariPool-1 - Start completed. 14:40:57 policy-api | [2024-01-14T14:31:48.421+00:00|WARN|deprecation|main] HHH90000025: PostgreSQLDialect does not need to be specified explicitly using 'hibernate.dialect' (remove the property setting and it will be selected by default) 14:40:57 policy-api | [2024-01-14T14:31:50.271+00:00|INFO|JtaPlatformInitiator|main] HHH000489: No JTA platform available (set 'hibernate.transaction.jta.platform' to enable JTA platform integration) 14:40:57 policy-api | [2024-01-14T14:31:50.274+00:00|INFO|LocalContainerEntityManagerFactoryBean|main] Initialized JPA EntityManagerFactory for persistence unit 'default' 14:40:57 policy-api | [2024-01-14T14:31:51.625+00:00|WARN|ApiDatabaseInitializer|main] Detected multi-versioned type: policytypes/onap.policies.monitoring.tcagen2.v2.yaml 14:40:57 policy-api | [2024-01-14T14:31:52.516+00:00|INFO|ApiDatabaseInitializer|main] Multi-versioned Service Template [onap.policies.Monitoring, onap.policies.monitoring.tcagen2] 14:40:57 policy-api | [2024-01-14T14:31:53.737+00:00|WARN|JpaBaseConfiguration$JpaWebConfiguration|main] spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 14:40:57 policy-api | [2024-01-14T14:31:53.937+00:00|INFO|DefaultSecurityFilterChain|main] Will secure any request with [org.springframework.security.web.session.DisableEncodeUrlFilter@4bbb00a4, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@543d242e, org.springframework.security.web.context.SecurityContextHolderFilter@62c4ad40, org.springframework.security.web.header.HeaderWriterFilter@4567dcbc, org.springframework.security.web.authentication.logout.LogoutFilter@53d257e7, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@58d291c1, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@9bc10bd, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@2e26841f, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@5f967ad3, org.springframework.security.web.access.ExceptionTranslationFilter@6aca85da, org.springframework.security.web.access.intercept.AuthorizationFilter@2f84848e] 14:40:57 policy-api | [2024-01-14T14:31:54.781+00:00|INFO|EndpointLinksResolver|main] Exposing 3 endpoint(s) beneath base path '' 14:40:57 policy-api | [2024-01-14T14:31:54.838+00:00|INFO|Http11NioProtocol|main] Starting ProtocolHandler ["http-nio-6969"] 14:40:57 policy-api | [2024-01-14T14:31:54.861+00:00|INFO|TomcatWebServer|main] Tomcat started on port(s): 6969 (http) with context path '/policy/api/v1' 14:40:57 policy-api | [2024-01-14T14:31:54.882+00:00|INFO|PolicyApiApplication|main] Started PolicyApiApplication in 11.423 seconds (process running for 12.01) 14:40:57 policy-api | [2024-01-14T14:32:33.700+00:00|INFO|[/policy/api/v1]|http-nio-6969-exec-2] Initializing Spring DispatcherServlet 'dispatcherServlet' 14:40:57 policy-api | [2024-01-14T14:32:33.700+00:00|INFO|DispatcherServlet|http-nio-6969-exec-2] Initializing Servlet 'dispatcherServlet' 14:40:57 policy-api | [2024-01-14T14:32:33.701+00:00|INFO|DispatcherServlet|http-nio-6969-exec-2] Completed initialization in 1 ms 14:40:57 policy-api | [2024-01-14T14:32:33.989+00:00|INFO|OrderedServiceImpl|http-nio-6969-exec-2] ***** OrderedServiceImpl implementers: 14:40:57 policy-api | [] 14:40:57 policy-apex-pdp | [2024-01-14T14:32:15.297+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:15.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:15.298+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:15.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:15.299+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:16.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 7116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:16.347+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:16.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:16.348+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:16.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:16.349+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:17.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 8166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:17.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:17.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:17.398+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:17.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | Waiting for postgres port 5432... 14:40:57 policy-db-migrator | nc: connect to postgres (172.17.0.2) port 5432 (tcp) failed: Connection refused 14:40:57 policy-db-migrator | nc: connect to postgres (172.17.0.2) port 5432 (tcp) failed: Connection refused 14:40:57 policy-db-migrator | nc: connect to postgres (172.17.0.2) port 5432 (tcp) failed: Connection refused 14:40:57 policy-db-migrator | nc: connect to postgres (172.17.0.2) port 5432 (tcp) failed: Connection refused 14:40:57 policy-db-migrator | Connection to postgres (172.17.0.2) 5432 port [tcp/postgresql] succeeded! 14:40:57 policy-db-migrator | 321 blocks 14:40:57 policy-db-migrator | Preparing upgrade release version: 0800 14:40:57 policy-db-migrator | Preparing upgrade release version: 0900 14:40:57 policy-db-migrator | Preparing upgrade release version: 1000 14:40:57 policy-db-migrator | Preparing upgrade release version: 1100 14:40:57 policy-db-migrator | Preparing upgrade release version: 1200 14:40:57 policy-db-migrator | Preparing upgrade release version: 1300 14:40:57 policy-db-migrator | Done 14:40:57 policy-db-migrator | List of databases 14:40:57 policy-db-migrator | Name | Owner | Encoding | Collate | Ctype | ICU Locale | Locale Provider | Access privileges 14:40:57 policy-db-migrator | -------------------+----------+----------+------------+------------+------------+-----------------+-------------------------- 14:40:57 policy-db-migrator | clampacm | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | migration | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | operationshistory | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | policyadmin | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | policyclamp | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | pooling | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | postgres | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | 14:40:57 policy-db-migrator | template0 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =c/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres 14:40:57 policy-db-migrator | template1 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =c/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres 14:40:57 policy-db-migrator | (9 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | ?column? 14:40:57 policy-db-migrator | ---------- 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | ?column? 14:40:57 policy-db-migrator | ---------- 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | name | version 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:17.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:18.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 9216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:18.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:18.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:18.448+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:18.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:18.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:19.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 10266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:19.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:19.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:19.498+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:19.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | -------------+--------- 14:40:57 policy-db-migrator | policyadmin | 0 14:40:57 policy-db-migrator | (1 row) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | id | script | operation | from_version | to_version | tag | success | attime 14:40:57 policy-db-migrator | ----+--------+-----------+--------------+------------+-----+---------+-------- 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | policyadmin: upgrade available: 0 -> 1300 14:40:57 policy-db-migrator | List of databases 14:40:57 policy-db-migrator | Name | Owner | Encoding | Collate | Ctype | ICU Locale | Locale Provider | Access privileges 14:40:57 policy-db-migrator | -------------------+----------+----------+------------+------------+------------+-----------------+-------------------------- 14:40:57 policy-db-migrator | clampacm | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | migration | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | operationshistory | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | policyadmin | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | policyclamp | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | pooling | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-db-migrator | postgres | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | 14:40:57 policy-db-migrator | template0 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =c/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres 14:40:57 policy-db-migrator | template1 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =c/postgres + 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres 14:40:57 policy-db-migrator | (9 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | ?column? 14:40:57 policy-db-migrator | ---------- 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | NOTICE: relation "schema_versions" already exists, skipping 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | NOTICE: relation "policyadmin_schema_changelog" already exists, skipping 14:40:57 policy-db-migrator | ?column? 14:40:57 policy-db-migrator | ---------- 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | upgrade: 0 -> 1300 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0100-jpapdpgroup_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0110-jpapdpstatistics_enginestats.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0120-jpapdpsubgroup_policies.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0130-jpapdpsubgroup_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0140-jpapdpsubgroup_supportedpolicytypes.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0150-jpatoscacapabilityassignment_attributes.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0160-jpatoscacapabilityassignment_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0170-jpatoscacapabilityassignment_occurrences.sql 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:19.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:20.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 11316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:20.547+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:20.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:20.548+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:20.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:20.549+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:21.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 12366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:21.597+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:21.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:21.598+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:21.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:21.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:22.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 13416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:22.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0180-jpatoscacapabilityassignment_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0190-jpatoscacapabilitytype_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0200-jpatoscacapabilitytype_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0210-jpatoscadatatype_constraints.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0220-jpatoscadatatype_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0230-jpatoscadatatype_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0240-jpatoscanodetemplate_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0250-jpatoscanodetemplate_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0260-jpatoscanodetype_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0270-jpatoscanodetype_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0280-jpatoscapolicy_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0290-jpatoscapolicy_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0300-jpatoscapolicy_targets.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0310-jpatoscapolicytype_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0320-jpatoscapolicytype_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0330-jpatoscapolicytype_targets.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0340-jpatoscapolicytype_triggers.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0350-jpatoscaproperty_constraints.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0360-jpatoscaproperty_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0370-jpatoscarelationshiptype_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0380-jpatoscarelationshiptype_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0390-jpatoscarequirement_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0400-jpatoscarequirement_occurrences.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | Waiting for postgres port 5432... 14:40:57 policy-pap | Waiting for message-router port 3904... 14:40:57 policy-pap | Waiting for api port 6969... 14:40:57 policy-pap | postgres (172.17.0.2:5432) open 14:40:57 policy-pap | message-router (172.17.0.4:3904) open 14:40:57 policy-pap | api (172.17.0.6:6969) open 14:40:57 policy-pap | Policy pap config file: /opt/app/policy/pap/etc/papParameters.yaml 14:40:57 policy-pap | PDP group configuration file: PapDb.json 14:40:57 policy-pap | 14:40:57 policy-pap | . ____ _ __ _ _ 14:40:57 policy-pap | /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ 14:40:57 policy-pap | ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ 14:40:57 policy-pap | \\/ ___)| |_)| | | | | || (_| | ) ) ) ) 14:40:57 policy-pap | ' |____| .__|_| |_|_| |_\__, | / / / / 14:40:57 policy-pap | =========|_|==============|___/=/_/_/_/ 14:40:57 policy-pap | :: Spring Boot :: (v3.1.4) 14:40:57 policy-pap | 14:40:57 policy-pap | [2024-01-14T14:31:57.181+00:00|INFO|PolicyPapApplication|main] Starting PolicyPapApplication using Java 17.0.9 with PID 28 (/app/pap.jar started by policy in /opt/app/policy/pap/bin) 14:40:57 policy-pap | [2024-01-14T14:31:57.183+00:00|INFO|PolicyPapApplication|main] No active profile set, falling back to 1 default profile: "default" 14:40:57 policy-pap | [2024-01-14T14:31:59.016+00:00|INFO|RepositoryConfigurationDelegate|main] Bootstrapping Spring Data JPA repositories in DEFAULT mode. 14:40:57 policy-pap | [2024-01-14T14:31:59.122+00:00|INFO|RepositoryConfigurationDelegate|main] Finished Spring Data repository scanning in 96 ms. Found 7 JPA repository interfaces. 14:40:57 policy-pap | [2024-01-14T14:31:59.578+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.pap.main.exception.ServiceExceptionHandler 14:40:57 policy-pap | [2024-01-14T14:31:59.579+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.pap.main.exception.ServiceExceptionHandler 14:40:57 policy-pap | [2024-01-14T14:32:00.241+00:00|INFO|TomcatWebServer|main] Tomcat initialized with port(s): 6969 (http) 14:40:57 policy-pap | [2024-01-14T14:32:00.250+00:00|INFO|Http11NioProtocol|main] Initializing ProtocolHandler ["http-nio-6969"] 14:40:57 policy-pap | [2024-01-14T14:32:00.254+00:00|INFO|StandardService|main] Starting service [Tomcat] 14:40:57 policy-pap | [2024-01-14T14:32:00.254+00:00|INFO|StandardEngine|main] Starting Servlet engine: [Apache Tomcat/10.1.16] 14:40:57 policy-pap | [2024-01-14T14:32:00.364+00:00|INFO|[/policy/pap/v1]|main] Initializing Spring embedded WebApplicationContext 14:40:57 policy-pap | [2024-01-14T14:32:00.365+00:00|INFO|ServletWebServerApplicationContext|main] Root WebApplicationContext: initialization completed in 3103 ms 14:40:57 policy-pap | [2024-01-14T14:32:00.872+00:00|INFO|LogHelper|main] HHH000204: Processing PersistenceUnitInfo [name: default] 14:40:57 policy-pap | [2024-01-14T14:32:00.958+00:00|INFO|Version|main] HHH000412: Hibernate ORM core version 6.3.0.CR1 14:40:57 policy-pap | [2024-01-14T14:32:00.961+00:00|INFO|Environment|main] HHH000406: Using bytecode reflection optimizer 14:40:57 policy-pap | [2024-01-14T14:32:01.014+00:00|INFO|RegionFactoryInitiator|main] HHH000026: Second-level cache disabled 14:40:57 policy-pap | [2024-01-14T14:32:01.379+00:00|INFO|SpringPersistenceUnitInfo|main] No LoadTimeWeaver setup: ignoring JPA class transformer 14:40:57 policy-pap | [2024-01-14T14:32:01.400+00:00|INFO|HikariDataSource|main] HikariPool-1 - Starting... 14:40:57 policy-pap | [2024-01-14T14:32:01.527+00:00|INFO|HikariPool|main] HikariPool-1 - Added connection org.postgresql.jdbc.PgConnection@7342e05d 14:40:57 policy-pap | [2024-01-14T14:32:01.530+00:00|INFO|HikariDataSource|main] HikariPool-1 - Start completed. 14:40:57 policy-pap | [2024-01-14T14:32:01.578+00:00|WARN|deprecation|main] HHH90000025: PostgreSQLDialect does not need to be specified explicitly using 'hibernate.dialect' (remove the property setting and it will be selected by default) 14:40:57 policy-pap | [2024-01-14T14:32:03.492+00:00|INFO|JtaPlatformInitiator|main] HHH000489: No JTA platform available (set 'hibernate.transaction.jta.platform' to enable JTA platform integration) 14:40:57 policy-pap | [2024-01-14T14:32:03.495+00:00|INFO|LocalContainerEntityManagerFactoryBean|main] Initialized JPA EntityManagerFactory for persistence unit 'default' 14:40:57 policy-pap | [2024-01-14T14:32:04.044+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.pap.main.repository.PdpGroupRepository 14:40:57 policy-pap | [2024-01-14T14:32:04.634+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.pap.main.repository.PolicyStatusRepository 14:40:57 policy-pap | [2024-01-14T14:32:04.767+00:00|WARN|LocalVariableTableParameterNameDiscoverer|main] Using deprecated '-debug' fallback for parameter name resolution. Compile the affected code with '-parameters' instead or avoid its introspection: org.onap.policy.pap.main.repository.PolicyAuditRepository 14:40:57 policy-pap | [2024-01-14T14:32:05.346+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 policy-pap | [2024-01-14T14:32:05.359+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 policy-apex-pdp | [2024-01-14T14:32:22.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:22.648+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:22.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:22.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:23.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 14466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:23.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:23.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:23.698+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:23.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | [2024-01-14T14:32:05.777+00:00|INFO|PapDatabaseInitializer|main] Created initial pdpGroup in DB - PdpGroups(groups=[PdpGroup(name=defaultGroup, description=The default group that registers all supported policy types and pdps., pdpGroupState=ACTIVE, properties=null, pdpSubgroups=[PdpSubGroup(pdpType=xacml, supportedPolicyTypes=[onap.policies.controlloop.guard.common.FrequencyLimiter 1.0.0, onap.policies.controlloop.guard.common.MinMax 1.0.0, onap.policies.controlloop.guard.common.Blacklist 1.0.0, onap.policies.controlloop.guard.common.Filter 1.0.0, onap.policies.controlloop.guard.coordination.FirstBlocksSecond 1.0.0, onap.policies.monitoring.* 1.0.0, onap.policies.optimization.* 1.0.0, onap.policies.optimization.resource.AffinityPolicy 1.0.0, onap.policies.optimization.resource.DistancePolicy 1.0.0, onap.policies.optimization.resource.HpaPolicy 1.0.0, onap.policies.optimization.resource.OptimizationPolicy 1.0.0, onap.policies.optimization.resource.PciPolicy 1.0.0, onap.policies.optimization.service.QueryPolicy 1.0.0, onap.policies.optimization.service.SubscriberPolicy 1.0.0, onap.policies.optimization.resource.Vim_fit 1.0.0, onap.policies.optimization.resource.VnfPolicy 1.0.0, onap.policies.native.Xacml 1.0.0, onap.policies.Naming 1.0.0, onap.policies.match.* 1.0.0], policies=[SDNC_Policy.ONAP_NF_NAMING_TIMESTAMP 1.0.0], currentInstanceCount=0, desiredInstanceCount=1, properties=null, pdpInstances=null), PdpSubGroup(pdpType=drools, supportedPolicyTypes=[onap.policies.controlloop.operational.common.Drools 1.0.0, onap.policies.native.drools.Controller 1.0.0, onap.policies.native.drools.Artifact 1.0.0], policies=[], currentInstanceCount=0, desiredInstanceCount=1, properties=null, pdpInstances=null), PdpSubGroup(pdpType=apex, supportedPolicyTypes=[onap.policies.controlloop.operational.common.Apex 1.0.0, onap.policies.native.Apex 1.0.0], policies=[], currentInstanceCount=0, desiredInstanceCount=1, properties=null, pdpInstances=null)])]) from PapDb.json 14:40:57 policy-pap | [2024-01-14T14:32:05.929+00:00|WARN|JpaBaseConfiguration$JpaWebConfiguration|main] spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 14:40:57 policy-pap | [2024-01-14T14:32:06.155+00:00|INFO|DefaultSecurityFilterChain|main] Will secure any request with [org.springframework.security.web.session.DisableEncodeUrlFilter@22846a1d, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@fe38c0e, org.springframework.security.web.context.SecurityContextHolderFilter@12765ebd, org.springframework.security.web.header.HeaderWriterFilter@3966c679, org.springframework.security.web.authentication.logout.LogoutFilter@1999e1f5, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@1cca2e9d, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@3703a400, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@2336d3f, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@6167c42f, org.springframework.security.web.access.ExceptionTranslationFilter@5870fc05, org.springframework.security.web.access.intercept.AuthorizationFilter@447543ee] 14:40:57 policy-pap | [2024-01-14T14:32:07.017+00:00|INFO|EndpointLinksResolver|main] Exposing 3 endpoint(s) beneath base path '' 14:40:57 policy-pap | [2024-01-14T14:32:07.104+00:00|INFO|Http11NioProtocol|main] Starting ProtocolHandler ["http-nio-6969"] 14:40:57 policy-pap | [2024-01-14T14:32:07.127+00:00|INFO|TomcatWebServer|main] Tomcat started on port(s): 6969 (http) with context path '/policy/pap/v1' 14:40:57 policy-pap | [2024-01-14T14:32:07.146+00:00|INFO|ServiceManager|main] Policy PAP starting 14:40:57 policy-pap | [2024-01-14T14:32:07.146+00:00|INFO|ServiceManager|main] Policy PAP starting Meter Registry 14:40:57 policy-pap | [2024-01-14T14:32:07.147+00:00|INFO|ServiceManager|main] Policy PAP starting PAP parameters 14:40:57 policy-pap | [2024-01-14T14:32:07.147+00:00|INFO|ServiceManager|main] Policy PAP starting Pdp Heartbeat Listener 14:40:57 policy-pap | [2024-01-14T14:32:07.148+00:00|INFO|ServiceManager|main] Policy PAP starting Response Request ID Dispatcher 14:40:57 policy-pap | [2024-01-14T14:32:07.148+00:00|INFO|ServiceManager|main] Policy PAP starting Heartbeat Request ID Dispatcher 14:40:57 policy-pap | [2024-01-14T14:32:07.148+00:00|INFO|ServiceManager|main] Policy PAP starting Response Message Dispatcher 14:40:57 policy-pap | [2024-01-14T14:32:07.153+00:00|INFO|TopicBase|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@7e615c6a 14:40:57 policy-pap | [2024-01-14T14:32:07.154+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: starting 14:40:57 policy-pap | [2024-01-14T14:32:07.154+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: INITTED 14:40:57 policy-pap | [2024-01-14T14:32:07.155+00:00|INFO|ServiceManager|main] Policy PAP starting Heartbeat Message Dispatcher 14:40:57 policy-pap | [2024-01-14T14:32:07.155+00:00|INFO|TopicBase|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=0]]]]: registering org.onap.policy.common.endpoints.listeners.MessageTypeDispatcher@3662c887 14:40:57 policy-pap | [2024-01-14T14:32:07.155+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: starting 14:40:57 policy-pap | [2024-01-14T14:32:07.155+00:00|INFO|SingleThreadedDmaapTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=false, locked=false, uebThread=null, topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: INITTED 14:40:57 policy-pap | [2024-01-14T14:32:07.156+00:00|INFO|ServiceManager|main] Policy PAP starting topics 14:40:57 simulator | Policy simulator config file: /opt/app/policy/simulators/etc/mounted/simParameters.json 14:40:57 simulator | overriding logback.xml 14:40:57 simulator | 2024-01-14 14:31:38,508 INFO replacing 'HOST_NAME' with simulator in /opt/app/policy/simulators/etc/mounted/simParameters.json 14:40:57 simulator | 2024-01-14 14:31:38,597 INFO org.onap.policy.models.simulators starting 14:40:57 simulator | 2024-01-14 14:31:38,598 INFO org.onap.policy.models.simulators starting DMaaP provider 14:40:57 simulator | 2024-01-14 14:31:38,599 INFO service manager starting 14:40:57 simulator | 2024-01-14 14:31:38,599 INFO service manager starting Topic Sweeper 14:40:57 simulator | 2024-01-14 14:31:38,600 INFO service manager started 14:40:57 simulator | 2024-01-14 14:31:38,600 INFO org.onap.policy.models.simulators starting CDS gRPC Server Properties 14:40:57 simulator | 2024-01-14 14:31:38,854 INFO org.onap.policy.models.simulators starting DMaaP simulator 14:40:57 simulator | 2024-01-14 14:31:38,961 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=DMaaP simulator, host=0.0.0.0, port=3904, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@fd8294b{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@5974109{/,null,STOPPED}, connector=DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: WAITED-START 14:40:57 simulator | 2024-01-14 14:31:38,973 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=DMaaP simulator, host=0.0.0.0, port=3904, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@fd8294b{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@5974109{/,null,STOPPED}, connector=DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:38,995 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=DMaaP simulator, host=0.0.0.0, port=3904, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@fd8294b{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@5974109{/,null,STOPPED}, connector=DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904}, jettyThread=Thread[DMaaP simulator-3904,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:38,998 INFO jetty-11.0.18; built: 2023-10-27T02:14:36.036Z; git: 5a9a771a9fbcb9d36993630850f612581b78c13f; jvm 17.0.9+8-alpine-r0 14:40:57 simulator | 2024-01-14 14:31:39,048 INFO Session workerName=node0 14:40:57 simulator | 2024-01-14 14:31:39,506 INFO Using GSON for REST calls 14:40:57 simulator | 2024-01-14 14:31:39,559 INFO Started o.e.j.s.ServletContextHandler@5974109{/,null,AVAILABLE} 14:40:57 simulator | 2024-01-14 14:31:39,566 INFO Started DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904} 14:40:57 simulator | 2024-01-14 14:31:39,572 INFO Started Server@fd8294b{STARTING}[11.0.18,sto=0] @1600ms 14:40:57 simulator | 2024-01-14 14:31:39,572 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=DMaaP simulator, host=0.0.0.0, port=3904, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@fd8294b{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@5974109{/,null,AVAILABLE}, connector=DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904}, jettyThread=Thread[DMaaP simulator-3904,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: pending time is 4423 ms. 14:40:57 simulator | 2024-01-14 14:31:39,578 INFO org.onap.policy.models.simulators starting org.onap.policy.simulators.AaiSimulatorJaxRs_RESOURCE_LOCATION 14:40:57 simulator | 2024-01-14 14:31:39,579 INFO org.onap.policy.models.simulators starting A&AI simulator 14:40:57 simulator | 2024-01-14 14:31:39,582 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=A&AI simulator, host=0.0.0.0, port=6666, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4fc5e095{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@435871cb{/,null,STOPPED}, connector=A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: WAITED-START 14:40:57 simulator | 2024-01-14 14:31:39,583 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=A&AI simulator, host=0.0.0.0, port=6666, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4fc5e095{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@435871cb{/,null,STOPPED}, connector=A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,584 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=A&AI simulator, host=0.0.0.0, port=6666, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4fc5e095{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@435871cb{/,null,STOPPED}, connector=A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666}, jettyThread=Thread[A&AI simulator-6666,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,585 INFO jetty-11.0.18; built: 2023-10-27T02:14:36.036Z; git: 5a9a771a9fbcb9d36993630850f612581b78c13f; jvm 17.0.9+8-alpine-r0 14:40:57 simulator | 2024-01-14 14:31:39,594 INFO Session workerName=node0 14:40:57 simulator | 2024-01-14 14:31:39,671 INFO Using GSON for REST calls 14:40:57 simulator | 2024-01-14 14:31:39,685 INFO Started o.e.j.s.ServletContextHandler@435871cb{/,null,AVAILABLE} 14:40:57 simulator | 2024-01-14 14:31:39,686 INFO Started A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666} 14:40:57 simulator | 2024-01-14 14:31:39,687 INFO Started Server@4fc5e095{STARTING}[11.0.18,sto=0] @1715ms 14:40:57 simulator | 2024-01-14 14:31:39,687 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=A&AI simulator, host=0.0.0.0, port=6666, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4fc5e095{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@435871cb{/,null,AVAILABLE}, connector=A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666}, jettyThread=Thread[A&AI simulator-6666,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: pending time is 4897 ms. 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0410-jpatoscarequirement_properties.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0420-jpatoscaservicetemplate_metadata.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0430-jpatoscatopologytemplate_inputs.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0440-pdpgroup_pdpsubgroup.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0450-pdpgroup.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:39,688 INFO org.onap.policy.models.simulators starting SDNC simulator 14:40:57 simulator | 2024-01-14 14:31:39,693 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=SDNC simulator, host=0.0.0.0, port=6668, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4bef0fe3{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@62ea3440{/,null,STOPPED}, connector=SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: WAITED-START 14:40:57 simulator | 2024-01-14 14:31:39,693 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=SDNC simulator, host=0.0.0.0, port=6668, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4bef0fe3{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@62ea3440{/,null,STOPPED}, connector=SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,694 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=SDNC simulator, host=0.0.0.0, port=6668, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4bef0fe3{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@62ea3440{/,null,STOPPED}, connector=SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668}, jettyThread=Thread[SDNC simulator-6668,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,695 INFO jetty-11.0.18; built: 2023-10-27T02:14:36.036Z; git: 5a9a771a9fbcb9d36993630850f612581b78c13f; jvm 17.0.9+8-alpine-r0 14:40:57 simulator | 2024-01-14 14:31:39,701 INFO Session workerName=node0 14:40:57 simulator | 2024-01-14 14:31:39,745 INFO Using GSON for REST calls 14:40:57 simulator | 2024-01-14 14:31:39,752 INFO Started o.e.j.s.ServletContextHandler@62ea3440{/,null,AVAILABLE} 14:40:57 simulator | 2024-01-14 14:31:39,753 INFO Started SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668} 14:40:57 simulator | 2024-01-14 14:31:39,754 INFO Started Server@4bef0fe3{STARTING}[11.0.18,sto=0] @1781ms 14:40:57 simulator | 2024-01-14 14:31:39,754 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=SDNC simulator, host=0.0.0.0, port=6668, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4bef0fe3{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@62ea3440{/,null,AVAILABLE}, connector=SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668}, jettyThread=Thread[SDNC simulator-6668,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: pending time is 4940 ms. 14:40:57 simulator | 2024-01-14 14:31:39,754 INFO org.onap.policy.models.simulators starting SO simulator 14:40:57 simulator | 2024-01-14 14:31:39,756 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=SO simulator, host=0.0.0.0, port=6669, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@5bfa8cc5{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@666b83a4{/,null,STOPPED}, connector=SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: WAITED-START 14:40:57 simulator | 2024-01-14 14:31:39,756 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=SO simulator, host=0.0.0.0, port=6669, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@5bfa8cc5{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@666b83a4{/,null,STOPPED}, connector=SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,757 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=SO simulator, host=0.0.0.0, port=6669, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@5bfa8cc5{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@666b83a4{/,null,STOPPED}, connector=SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669}, jettyThread=Thread[SO simulator-6669,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,757 INFO jetty-11.0.18; built: 2023-10-27T02:14:36.036Z; git: 5a9a771a9fbcb9d36993630850f612581b78c13f; jvm 17.0.9+8-alpine-r0 14:40:57 simulator | 2024-01-14 14:31:39,762 INFO Session workerName=node0 14:40:57 simulator | 2024-01-14 14:31:39,824 INFO Using GSON for REST calls 14:40:57 simulator | 2024-01-14 14:31:39,838 INFO Started o.e.j.s.ServletContextHandler@666b83a4{/,null,AVAILABLE} 14:40:57 simulator | 2024-01-14 14:31:39,842 INFO Started SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669} 14:40:57 simulator | 2024-01-14 14:31:39,842 INFO Started Server@5bfa8cc5{STARTING}[11.0.18,sto=0] @1870ms 14:40:57 simulator | 2024-01-14 14:31:39,842 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=SO simulator, host=0.0.0.0, port=6669, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@5bfa8cc5{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@666b83a4{/,null,AVAILABLE}, connector=SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669}, jettyThread=Thread[SO simulator-6669,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: pending time is 4914 ms. 14:40:57 simulator | 2024-01-14 14:31:39,843 INFO org.onap.policy.models.simulators starting VFC simulator 14:40:57 simulator | 2024-01-14 14:31:39,846 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=VFC simulator, host=0.0.0.0, port=6670, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@2b95e48b{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@4a3329b9{/,null,STOPPED}, connector=VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: WAITED-START 14:40:57 simulator | 2024-01-14 14:31:39,847 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=VFC simulator, host=0.0.0.0, port=6670, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@2b95e48b{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@4a3329b9{/,null,STOPPED}, connector=VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670}, jettyThread=null, servlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,848 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}}, swaggerId=null, toString()=JettyServletServer(name=VFC simulator, host=0.0.0.0, port=6670, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@2b95e48b{STOPPED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@4a3329b9{/,null,STOPPED}, connector=VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670}, jettyThread=Thread[VFC simulator-6670,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=false,async=true,src=EMBEDDED:null,STOPPED}})]: STARTING 14:40:57 simulator | 2024-01-14 14:31:39,848 INFO jetty-11.0.18; built: 2023-10-27T02:14:36.036Z; git: 5a9a771a9fbcb9d36993630850f612581b78c13f; jvm 17.0.9+8-alpine-r0 14:40:57 simulator | 2024-01-14 14:31:39,853 INFO Session workerName=node0 14:40:57 simulator | 2024-01-14 14:31:39,906 INFO Using GSON for REST calls 14:40:57 simulator | 2024-01-14 14:31:39,913 INFO Started o.e.j.s.ServletContextHandler@4a3329b9{/,null,AVAILABLE} 14:40:57 simulator | 2024-01-14 14:31:39,915 INFO Started VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670} 14:40:57 simulator | 2024-01-14 14:31:39,915 INFO Started Server@2b95e48b{STARTING}[11.0.18,sto=0] @1943ms 14:40:57 simulator | 2024-01-14 14:31:39,915 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=VFC simulator, host=0.0.0.0, port=6670, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@2b95e48b{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@4a3329b9{/,null,AVAILABLE}, connector=VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670}, jettyThread=Thread[VFC simulator-6670,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: pending time is 4933 ms. 14:40:57 simulator | 2024-01-14 14:31:39,916 INFO org.onap.policy.models.simulators starting Sink appc-cl 14:40:57 simulator | 2024-01-14 14:31:39,928 INFO InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=5309e869-32e5-47dd-8977-fc96496c5cf1, alive=false, publisher=null]]: starting 14:40:57 simulator | 2024-01-14 14:31:40,249 INFO InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=5309e869-32e5-47dd-8977-fc96496c5cf1, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 14:40:57 simulator | 2024-01-14 14:31:40,251 INFO org.onap.policy.models.simulators starting Sink appc-lcm-write 14:40:57 simulator | 2024-01-14 14:31:40,251 INFO InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=0c7d18c1-e767-46c4-915a-748cccd62718, alive=false, publisher=null]]: starting 14:40:57 simulator | 2024-01-14 14:31:40,252 INFO InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=0c7d18c1-e767-46c4-915a-748cccd62718, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 14:40:57 simulator | 2024-01-14 14:31:40,252 INFO org.onap.policy.models.simulators starting Source appc-cl 14:40:57 simulator | 2024-01-14 14:31:40,256 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=6820140e-05cd-41eb-879f-ce37cc126ef6, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-cl, effectiveTopic=appc-cl, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 simulator | 2024-01-14 14:31:40,281 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=6820140e-05cd-41eb-879f-ce37cc126ef6, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-cl, effectiveTopic=appc-cl, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 14:40:57 simulator | 2024-01-14 14:31:40,282 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=6820140e-05cd-41eb-879f-ce37cc126ef6, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-cl, effectiveTopic=appc-cl, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 simulator | 2024-01-14 14:31:40,283 INFO org.onap.policy.models.simulators starting Source appc-lcm-read 14:40:57 simulator | 2024-01-14 14:31:40,283 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d1aa854b-f337-437c-8466-8727aee92721, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-lcm-read, effectiveTopic=appc-lcm-read, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 simulator | 2024-01-14 14:31:40,283 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d1aa854b-f337-437c-8466-8727aee92721, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-lcm-read, effectiveTopic=appc-lcm-read, #recentEvents=0, locked=false, #topicListeners=0]]]]: starting 14:40:57 simulator | 2024-01-14 14:31:40,284 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d1aa854b-f337-437c-8466-8727aee92721, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=false, locked=false, uebThread=null, topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-lcm-read, effectiveTopic=appc-lcm-read, #recentEvents=0, locked=false, #topicListeners=0]]]]: INITTED 14:40:57 simulator | 2024-01-14 14:31:40,285 INFO org.onap.policy.models.simulators starting APPC Legacy simulator 14:40:57 simulator | 2024-01-14 14:31:40,294 ERROR org.onap.policy.models.simulators failed to start APPC Legacy simulator; rewinding steps 14:40:57 simulator | 2024-01-14 14:31:40,294 INFO org.onap.policy.models.simulators stopping 14:40:57 simulator | 2024-01-14 14:31:40,294 INFO org.onap.policy.models.simulators stopping Source appc-lcm-read 14:40:57 simulator | 2024-01-14 14:31:40,294 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d1aa854b-f337-437c-8466-8727aee92721, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-appc-lcm-read,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-lcm-read, effectiveTopic=appc-lcm-read, #recentEvents=0, locked=false, #topicListeners=0]]]]: stopping 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO org.onap.policy.models.simulators stopping Source appc-cl 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=6820140e-05cd-41eb-879f-ce37cc126ef6, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-appc-cl,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-cl, effectiveTopic=appc-cl, #recentEvents=0, locked=false, #topicListeners=0]]]]: stopping 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO org.onap.policy.models.simulators stopping Sink appc-lcm-write 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO CambriaPublisherWrapper []: CLOSE 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO org.onap.policy.models.simulators stopping Sink appc-cl 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO CambriaPublisherWrapper []: CLOSE 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO org.onap.policy.models.simulators stopping VFC simulator 14:40:57 simulator | 2024-01-14 14:31:40,295 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=VFC simulator, host=0.0.0.0, port=6670, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@2b95e48b{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@4a3329b9{/,null,AVAILABLE}, connector=VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670}, jettyThread=Thread[VFC simulator-6670,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: SHUTTING DOWN 14:40:57 simulator | 2024-01-14 14:31:40,296 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=VFC simulator, host=0.0.0.0, port=6670, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@2b95e48b{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@4a3329b9{/,null,AVAILABLE}, connector=VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670}, jettyThread=Thread[VFC simulator-6670,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-3b220bcb==org.glassfish.jersey.servlet.ServletContainer@2323602e{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: STOPPING 14:40:57 simulator | 2024-01-14 14:31:40,298 INFO UEB GET /events/appc-lcm-read/d1aa854b-f337-437c-8466-8727aee92721/simulator 14:40:57 simulator | 2024-01-14 14:31:40,298 INFO UEB GET /events/appc-cl/6820140e-05cd-41eb-879f-ce37cc126ef6/simulator 14:40:57 simulator | 2024-01-14 14:31:40,299 INFO Stopped VFC simulator@efde75f{HTTP/1.1, (http/1.1)}{0.0.0.0:6670} 14:40:57 simulator | 2024-01-14 14:31:40,299 INFO Stopped Server@2b95e48b{STOPPING}[11.0.18,sto=0] 14:40:57 simulator | 2024-01-14 14:31:40,307 INFO Stopped o.e.j.s.ServletContextHandler@4a3329b9{/,null,STOPPED} 14:40:57 simulator | 2024-01-14 14:31:40,309 INFO org.onap.policy.models.simulators stopping SO simulator 14:40:57 simulator | 2024-01-14 14:31:40,309 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=SO simulator, host=0.0.0.0, port=6669, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@5bfa8cc5{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@666b83a4{/,null,AVAILABLE}, connector=SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669}, jettyThread=Thread[SO simulator-6669,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: SHUTTING DOWN 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:23.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:24.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 15516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:24.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:24.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.251+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | [2024-01-14T14:32:07.156+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: starting 14:40:57 policy-pap | [2024-01-14T14:32:07.156+00:00|INFO|SingleThreadedBusTopicSource|main] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: starting 14:40:57 policy-pap | [2024-01-14T14:32:07.157+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:32:07.157+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:32:07.156+00:00|INFO|InlineBusTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=1dc0cca1-576b-447d-a1e5-5ff8b9f01ed8, alive=false, publisher=null]]: starting 14:40:57 policy-pap | [2024-01-14T14:32:07.161+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:32:07.161+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:32:07.162+00:00|INFO|InlineDmaapTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=1dc0cca1-576b-447d-a1e5-5ff8b9f01ed8, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 14:40:57 policy-pap | [2024-01-14T14:32:07.162+00:00|INFO|InlineBusTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=c6774e85-38f4-4130-a50a-2f06e0cb050a, alive=false, publisher=null]]: starting 14:40:57 policy-pap | [2024-01-14T14:32:07.163+00:00|INFO|InlineDmaapTopicSink|main] InlineDmaapTopicSink [userName=null, password=null, getTopicCommInfrastructure()=DMAAP, toString()=InlineBusTopicSink [partitionId=c6774e85-38f4-4130-a50a-2f06e0cb050a, alive=false, publisher=CambriaPublisherWrapper []]]: DMAAP SINK created 14:40:57 policy-pap | [2024-01-14T14:32:07.163+00:00|INFO|ServiceManager|main] Policy PAP starting PAP Activator 14:40:57 policy-pap | [2024-01-14T14:32:07.163+00:00|INFO|ServiceManager|main] Policy PAP starting PDP publisher 14:40:57 policy-pap | [2024-01-14T14:32:07.166+00:00|INFO|ServiceManager|main] Policy PAP starting Policy Notification publisher 14:40:57 policy-pap | [2024-01-14T14:32:07.171+00:00|INFO|ServiceManager|main] Policy PAP starting PDP update timers 14:40:57 policy-pap | [2024-01-14T14:32:07.177+00:00|INFO|ServiceManager|main] Policy PAP starting PDP state-change timers 14:40:57 policy-pap | [2024-01-14T14:32:07.177+00:00|INFO|ServiceManager|main] Policy PAP starting PDP modification lock 14:40:57 policy-pap | [2024-01-14T14:32:07.177+00:00|INFO|ServiceManager|main] Policy PAP starting PDP modification requests 14:40:57 policy-pap | [2024-01-14T14:32:07.177+00:00|INFO|TimerManager|Thread-10] timer manager state-change started 14:40:57 policy-pap | [2024-01-14T14:32:07.178+00:00|INFO|TimerManager|Thread-9] timer manager update started 14:40:57 policy-pap | [2024-01-14T14:32:07.178+00:00|INFO|ServiceManager|main] Policy PAP starting PDP expiration timer 14:40:57 policy-pap | [2024-01-14T14:32:07.180+00:00|INFO|ServiceManager|main] Policy PAP started 14:40:57 policy-pap | [2024-01-14T14:32:07.181+00:00|INFO|PolicyPapApplication|main] Started PolicyPapApplication in 10.842 seconds (process running for 11.469) 14:40:57 policy-pap | [2024-01-14T14:32:12.199+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:32:12.199+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:32:12.200+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:32:12.199+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:32:12.200+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:32:12.200+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:32:27.200+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.251+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.251+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.252+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.752+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.753+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.753+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.753+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0460-pdppolicystatus.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0470-pdp.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0480-pdpstatistics.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0490-pdpsubgroup_pdp.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0500-pdpsubgroup.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0510-toscacapabilityassignment.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0520-toscacapabilityassignments.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0530-toscacapabilityassignments_toscacapabilityassignment.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0540-toscacapabilitytype.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 simulator | 2024-01-14 14:31:40,309 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=SO simulator, host=0.0.0.0, port=6669, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@5bfa8cc5{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@666b83a4{/,null,AVAILABLE}, connector=SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669}, jettyThread=Thread[SO simulator-6669,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-55b5f5d2==org.glassfish.jersey.servlet.ServletContainer@f89816de{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: STOPPING 14:40:57 simulator | 2024-01-14 14:31:40,310 INFO Stopped SO simulator@556d0826{HTTP/1.1, (http/1.1)}{0.0.0.0:6669} 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,310 INFO Stopped Server@5bfa8cc5{STOPPING}[11.0.18,sto=0] 14:40:57 prometheus | ts=2024-01-14T14:31:33.861Z caller=main.go:539 level=info msg="No time or size retention was set so using the default time retention" duration=15d 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,311 INFO Stopped o.e.j.s.ServletContextHandler@666b83a4{/,null,STOPPED} 14:40:57 prometheus | ts=2024-01-14T14:31:33.861Z caller=main.go:583 level=info msg="Starting Prometheus Server" mode=server version="(version=2.48.1, branch=HEAD, revision=63894216648f0d6be310c9d16fb48293c45c9310)" 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | > upgrade 0550-toscacapabilitytypes.sql 14:40:57 simulator | 2024-01-14 14:31:40,312 INFO org.onap.policy.models.simulators stopping SDNC simulator 14:40:57 prometheus | ts=2024-01-14T14:31:33.861Z caller=main.go:588 level=info build_context="(go=go1.21.5, platform=linux/amd64, user=root@71f108ff5632, date=20231208-23:33:22, tags=netgo,builtinassets,stringlabels)" 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,312 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=SDNC simulator, host=0.0.0.0, port=6668, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4bef0fe3{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@62ea3440{/,null,AVAILABLE}, connector=SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668}, jettyThread=Thread[SDNC simulator-6668,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: SHUTTING DOWN 14:40:57 prometheus | ts=2024-01-14T14:31:33.861Z caller=main.go:589 level=info host_details="(Linux 4.15.0-192-generic #203-Ubuntu SMP Wed Aug 10 17:40:03 UTC 2022 x86_64 prometheus (none))" 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | 2024-01-14 14:31:40,312 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=SDNC simulator, host=0.0.0.0, port=6668, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4bef0fe3{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@62ea3440{/,null,AVAILABLE}, connector=SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668}, jettyThread=Thread[SDNC simulator-6668,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-192d74fb==org.glassfish.jersey.servlet.ServletContainer@dd44a281{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: STOPPING 14:40:57 prometheus | ts=2024-01-14T14:31:33.861Z caller=main.go:590 level=info fd_limits="(soft=1048576, hard=1048576)" 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,313 INFO Stopped SDNC simulator@79da1ec0{HTTP/1.1, (http/1.1)}{0.0.0.0:6668} 14:40:57 prometheus | ts=2024-01-14T14:31:33.862Z caller=main.go:591 level=info vm_limits="(soft=unlimited, hard=unlimited)" 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,314 INFO Stopped Server@4bef0fe3{STOPPING}[11.0.18,sto=0] 14:40:57 prometheus | ts=2024-01-14T14:31:33.864Z caller=web.go:566 level=info component=web msg="Start listening for connections" address=0.0.0.0:9090 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | > upgrade 0560-toscacapabilitytypes_toscacapabilitytype.sql 14:40:57 simulator | 2024-01-14 14:31:40,315 INFO Stopped o.e.j.s.ServletContextHandler@62ea3440{/,null,STOPPED} 14:40:57 prometheus | ts=2024-01-14T14:31:33.865Z caller=main.go:1024 level=info msg="Starting TSDB ..." 14:40:57 policy-pap | [2024-01-14T14:32:27.204+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,315 WARN GET http://simulator:3904/events/appc-cl/6820140e-05cd-41eb-879f-ce37cc126ef6/simulator will send credentials over a clear channel. 14:40:57 prometheus | ts=2024-01-14T14:31:33.867Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9090 14:40:57 policy-pap | [2024-01-14T14:32:27.204+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | 2024-01-14 14:31:40,315 INFO GET http://simulator:3904/events/appc-cl/6820140e-05cd-41eb-879f-ce37cc126ef6/simulator (as some-key) ... 14:40:57 prometheus | ts=2024-01-14T14:31:33.867Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9090 14:40:57 policy-pap | [2024-01-14T14:32:27.204+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,316 INFO org.onap.policy.models.simulators stopping A&AI simulator 14:40:57 prometheus | ts=2024-01-14T14:31:33.871Z caller=head.go:601 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 14:40:57 policy-pap | [2024-01-14T14:32:27.200+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,316 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=A&AI simulator, host=0.0.0.0, port=6666, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4fc5e095{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@435871cb{/,null,AVAILABLE}, connector=A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666}, jettyThread=Thread[A&AI simulator-6666,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: SHUTTING DOWN 14:40:57 prometheus | ts=2024-01-14T14:31:33.871Z caller=head.go:682 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.421µs 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | > upgrade 0570-toscadatatype.sql 14:40:57 simulator | 2024-01-14 14:31:40,316 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=A&AI simulator, host=0.0.0.0, port=6666, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@4fc5e095{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@435871cb{/,null,AVAILABLE}, connector=A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666}, jettyThread=Thread[A&AI simulator-6666,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-75ed9710==org.glassfish.jersey.servlet.ServletContainer@cffad7c8{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: STOPPING 14:40:57 prometheus | ts=2024-01-14T14:31:33.871Z caller=head.go:690 level=info component=tsdb msg="Replaying WAL, this may take a while" 14:40:57 prometheus | ts=2024-01-14T14:31:33.872Z caller=head.go:761 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,316 WARN GET http://simulator:3904/events/appc-lcm-read/d1aa854b-f337-437c-8466-8727aee92721/simulator will send credentials over a clear channel. 14:40:57 prometheus | ts=2024-01-14T14:31:33.872Z caller=head.go:798 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=48.782µs wal_replay_duration=731.814µs wbl_replay_duration=340ns total_replay_duration=839.328µs 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | 2024-01-14 14:31:40,317 INFO GET http://simulator:3904/events/appc-lcm-read/d1aa854b-f337-437c-8466-8727aee92721/simulator (as some-key) ... 14:40:57 prometheus | ts=2024-01-14T14:31:33.876Z caller=main.go:1045 level=info fs_type=EXT4_SUPER_MAGIC 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,317 INFO Stopped A&AI simulator@6b9ce1bf{HTTP/1.1, (http/1.1)}{0.0.0.0:6666} 14:40:57 prometheus | ts=2024-01-14T14:31:33.876Z caller=main.go:1048 level=info msg="TSDB started" 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.753+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,317 INFO Stopped Server@4fc5e095{STOPPING}[11.0.18,sto=0] 14:40:57 prometheus | ts=2024-01-14T14:31:33.876Z caller=main.go:1230 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.753+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-db-migrator | > upgrade 0580-toscadatatypes.sql 14:40:57 simulator | 2024-01-14 14:31:40,318 INFO Stopped o.e.j.s.ServletContextHandler@435871cb{/,null,STOPPED} 14:40:57 prometheus | ts=2024-01-14T14:31:33.877Z caller=main.go:1267 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=1.067735ms db_storage=1.45µs remote_storage=1.65µs web_handler=190ns query_engine=1.02µs scrape=315.23µs scrape_sd=134.635µs notify=103.803µs notify_sd=15.301µs rules=2.16µs tracing=5.08µs 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:29.753+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 11, above threshold 10. 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,320 INFO org.onap.policy.models.simulators stopping org.onap.policy.simulators.AaiSimulatorJaxRs_RESOURCE_LOCATION 14:40:57 prometheus | ts=2024-01-14T14:31:33.878Z caller=main.go:1009 level=info msg="Server is ready to receive web requests." 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.539+00:00|INFO|RequestLog|qtp248710794-27] 172.17.0.1 - policyadmin [14/Jan/2024:14:32:30 +0000] "GET /policy/apex-pdp/v1/healthcheck HTTP/1.1" 200 109 "-" "curl/7.58.0" 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | 2024-01-14 14:31:40,320 INFO org.onap.policy.models.simulators stopping DMaaP simulator 14:40:57 prometheus | ts=2024-01-14T14:31:33.878Z caller=manager.go:1012 level=info component="rule manager" msg="Starting rule manager..." 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 21566 ms 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,320 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=DMaaP simulator, host=0.0.0.0, port=3904, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@fd8294b{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@5974109{/,null,AVAILABLE}, connector=DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904}, jettyThread=Thread[DMaaP simulator-3904,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: SHUTTING DOWN 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,320 INFO JettyJerseyServer [Jerseyservlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}}, swaggerId=null, toString()=JettyServletServer(name=DMaaP simulator, host=0.0.0.0, port=3904, sniHostCheck=false, user=null, password=null, contextPath=/, jettyServer=Server@fd8294b{STARTED}[11.0.18,sto=0], context=o.e.j.s.ServletContextHandler@5974109{/,null,AVAILABLE}, connector=DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904}, jettyThread=Thread[DMaaP simulator-3904,5,main], servlets={/*=org.glassfish.jersey.servlet.ServletContainer-6821ea29==org.glassfish.jersey.servlet.ServletContainer@ad0b2472{jsp=null,order=0,inst=true,async=true,src=EMBEDDED:null,STARTED}})]: STOPPING 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | > upgrade 0590-toscadatatypes_toscadatatype.sql 14:40:57 simulator | 2024-01-14 14:31:40,321 INFO Stopped DMaaP simulator@3e10dc6{HTTP/1.1, (http/1.1)}{0.0.0.0:3904} 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,321 INFO Stopped Server@fd8294b{STOPPING}[11.0.18,sto=0] 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 simulator | 2024-01-14 14:31:40,323 INFO Stopped o.e.j.s.ServletContextHandler@5974109{/,null,STOPPED} 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,328 INFO org.onap.policy.models.simulators stopping CDS gRPC Server Properties 14:40:57 policy-db-migrator | > upgrade 0600-toscanodetemplate.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 simulator | 2024-01-14 14:31:40,332 INFO org.onap.policy.models.simulators stopping DMaaP provider 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 simulator | 2024-01-14 14:31:40,333 INFO service manager stopping 14:40:57 policy-db-migrator | 14:40:57 policy-db-migrator | > upgrade 0610-toscanodetemplates.sql 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 simulator | 2024-01-14 14:31:40,334 INFO service manager stopping Topic Sweeper 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 simulator | 2024-01-14 14:31:40,334 INFO service manager stopped 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | > upgrade 0620-toscanodetemplates_toscanodetemplate.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,334 INFO org.onap.policy.models.simulators stopped 14:40:57 simulator | 2024-01-14 14:31:40,334 ERROR failed to start simulators 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | > upgrade 0630-toscanodetype.sql 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | org.onap.policy.common.utils.services.ServiceManagerException: java.lang.IllegalArgumentException: invalid sink topic APPC-CL 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | at org.onap.policy.common.utils.services.ServiceManager.start(ServiceManager.java:150) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | at org.onap.policy.common.utils.services.ServiceManagerContainer.start(ServiceManagerContainer.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | 14:40:57 simulator | at org.onap.policy.models.simulators.Main.main(Main.java:168) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-db-migrator | > upgrade 0640-toscanodetypes.sql 14:40:57 simulator | Caused by: java.lang.IllegalArgumentException: invalid sink topic APPC-CL 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | at org.onap.policy.models.simulators.Main.buildTopicServer(Main.java:248) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | at org.onap.policy.models.simulators.Main.lambda$new$12(Main.java:145) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | at org.onap.policy.common.utils.services.ServiceManager.start(ServiceManager.java:126) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | 14:40:57 simulator | ... 2 common frames omitted 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | > upgrade 0650-toscanodetypes_toscanodetype.sql 14:40:57 simulator | 2024-01-14 14:31:40,350 WARN Error executing HTTP request. Connect to simulator:3904 [simulator/172.17.0.4] failed: Connection refused; blacklisting for 2 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,350 WARN Error executing HTTP request. Connect to simulator:3904 [simulator/172.17.0.4] failed: Connection refused; blacklisting for 2 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | [2024-01-14T14:32:27.205+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | 2024-01-14 14:31:40,350 ERROR CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of Connect to simulator:3904 [simulator/172.17.0.4] failed: Connection refused 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | [2024-01-14T14:32:27.206+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,350 ERROR CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of Connect to simulator:3904 [simulator/172.17.0.4] failed: Connection refused 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | [2024-01-14T14:32:27.206+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-db-migrator | 14:40:57 simulator | 2024-01-14 14:31:40,351 INFO CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | [2024-01-14T14:32:32.211+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | > upgrade 0660-toscaparameter.sql 14:40:57 simulator | 2024-01-14 14:31:40,351 INFO CambriaConsumerWrapper [fetchTimeout=-1]: closed while handling fetch error 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:32:32.212+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | 2024-01-14 14:31:40,351 INFO CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | [2024-01-14T14:32:32.212+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | 2024-01-14 14:31:40,351 INFO CambriaConsumerWrapper [fetchTimeout=-1]: closed while handling fetch error 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | [2024-01-14T14:32:32.212+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | 2024-01-14 14:31:40,351 ERROR SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=6820140e-05cd-41eb-879f-ce37cc126ef6, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=null, alive=false, locked=false, uebThread=Thread[DMAAP-source-appc-cl,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-cl, effectiveTopic=appc-cl, #recentEvents=0, locked=false, #topicListeners=0]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:32:32.212+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-db-migrator | 14:40:57 simulator | org.apache.http.conn.HttpHostConnectException: Connect to simulator:3904 [simulator/172.17.0.4] failed: Connection refused 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | [2024-01-14T14:32:32.212+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-db-migrator | > upgrade 0670-toscapolicies.sql 14:40:57 simulator | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:30.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 12, above threshold 10. 14:40:57 policy-pap | [2024-01-14T14:32:34.765+00:00|INFO|[/policy/pap/v1]|http-nio-6969-exec-3] Initializing Spring DispatcherServlet 'dispatcherServlet' 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 22616 ms 14:40:57 policy-pap | [2024-01-14T14:32:34.765+00:00|INFO|DispatcherServlet|http-nio-6969-exec-3] Initializing Servlet 'dispatcherServlet' 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:32:34.767+00:00|INFO|DispatcherServlet|http-nio-6969-exec-3] Completed initialization in 1 ms 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.847+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:32:35.066+00:00|INFO|SessionData|http-nio-6969-exec-3] cache group defaultGroup 14:40:57 policy-db-migrator | 14:40:57 simulator | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.848+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:32:35.781+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-3] Registering a deploy for policy onap.policies.native.apex.Sampledomain 1.0.0 14:40:57 policy-db-migrator | > upgrade 0680-toscapolicies_toscapolicy.sql 14:40:57 simulator | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | [2024-01-14T14:32:35.782+00:00|INFO|SessionData|http-nio-6969-exec-3] update cached group defaultGroup 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 simulator | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | [2024-01-14T14:32:35.782+00:00|INFO|SessionData|http-nio-6969-exec-3] updating DB group defaultGroup 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 simulator | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | [2024-01-14T14:32:35.815+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-3] sending audit records to database: [PolicyAudit(auditId=null, pdpGroup=defaultGroup, pdpType=apex, policy=onap.policies.native.apex.Sampledomain 1.0.0, action=DEPLOYMENT, timestamp=2024-01-14T14:32:35Z, user=policyadmin)] 14:40:57 policy-db-migrator | rc=0 14:40:57 simulator | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:32:47.212+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 simulator | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | > upgrade 0690-toscapolicy.sql 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 simulator | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 simulator | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 simulator | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 simulator | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 simulator | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | > upgrade 0700-toscapolicytype.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 simulator | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 simulator | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 simulator | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 simulator | Caused by: java.net.ConnectException: Connection refused 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 simulator | at java.base/sun.nio.ch.Net.connect0(Native Method) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | > upgrade 0710-toscapolicytypes.sql 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 simulator | at java.base/sun.nio.ch.Net.connect(Net.java:579) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 simulator | at java.base/sun.nio.ch.Net.connect(Net.java:568) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 simulator | at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 simulator | at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 simulator | at java.base/java.net.Socket.connect(Socket.java:633) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | > upgrade 0720-toscapolicytypes_toscapolicytype.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 simulator | at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 simulator | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 simulator | ... 17 common frames omitted 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 simulator | 2024-01-14 14:31:40,352 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=6820140e-05cd-41eb-879f-ce37cc126ef6, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=null, alive=false, locked=false, uebThread=Thread[DMAAP-source-appc-cl,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-cl, effectiveTopic=appc-cl, #recentEvents=0, locked=false, #topicListeners=0]]]]: exiting thread 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 simulator | 2024-01-14 14:31:40,351 ERROR SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d1aa854b-f337-437c-8466-8727aee92721, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=null, alive=false, locked=false, uebThread=Thread[DMAAP-source-appc-lcm-read,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-lcm-read, effectiveTopic=appc-lcm-read, #recentEvents=0, locked=false, #topicListeners=0]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | > upgrade 0730-toscaproperty.sql 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 simulator | org.apache.http.conn.HttpHostConnectException: Connect to simulator:3904 [simulator/172.17.0.4] failed: Connection refused 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 simulator | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 simulator | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 simulator | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 simulator | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:31.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 13, above threshold 10. 14:40:57 policy-db-migrator | > upgrade 0740-toscarelationshiptype.sql 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 simulator | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 23666 ms 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 simulator | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:32:47.213+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 simulator | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:32:47.213+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 simulator | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.898+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:32:47.213+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 simulator | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | > upgrade 0750-toscarelationshiptypes.sql 14:40:57 policy-pap | [2024-01-14T14:32:47.213+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 simulator | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 simulator | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 simulator | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 simulator | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 simulator | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | > upgrade 0760-toscarelationshiptypes_toscarelationshiptype.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 simulator | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 simulator | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 simulator | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 simulator | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | > upgrade 0770-toscarequirement.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 simulator | Caused by: java.net.ConnectException: Connection refused 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 simulator | at java.base/sun.nio.ch.Net.connect0(Native Method) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 simulator | at java.base/sun.nio.ch.Net.connect(Net.java:579) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 simulator | at java.base/sun.nio.ch.Net.connect(Net.java:568) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 simulator | at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | > upgrade 0780-toscarequirements.sql 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 simulator | at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 simulator | at java.base/java.net.Socket.connect(Socket.java:633) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 simulator | at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 simulator | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 simulator | ... 17 common frames omitted 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | > upgrade 0790-toscarequirements_toscarequirement.sql 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 simulator | 2024-01-14 14:31:40,352 INFO SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=d1aa854b-f337-437c-8466-8727aee92721, consumerInstance=simulator, fetchTimeout=-1, fetchLimit=-1, consumer=null, alive=false, locked=false, uebThread=Thread[DMAAP-source-appc-lcm-read,5,main], topicListeners=0, toString()=BusTopicBase [apiKey=some-key, apiSecret=some-secret, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[simulator], topic=appc-lcm-read, effectiveTopic=appc-lcm-read, #recentEvents=0, locked=false, #topicListeners=0]]]]: exiting thread 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | > upgrade 0800-toscaservicetemplate.sql 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | [2024-01-14T14:32:47.213+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:32:47.214+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:32:47.214+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:32.898+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 14, above threshold 10. 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:32:52.219+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.646+00:00|INFO|RequestLog|qtp248710794-29] 172.17.0.1 - policyadmin [14/Jan/2024:14:32:33 +0000] "GET /policy/apex-pdp/v1/healthcheck?null HTTP/1.1" 200 109 "-" "python-requests/2.27.1" 14:40:57 policy-db-migrator | > upgrade 0810-toscatopologytemplate.sql 14:40:57 policy-pap | [2024-01-14T14:32:52.219+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 24716 ms 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | [2024-01-14T14:32:52.220+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:32:52.220+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:32:52.220+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.948+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:32:52.220+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | > upgrade 0820-toscatrigger.sql 14:40:57 policy-pap | [2024-01-14T14:33:07.220+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | > upgrade 0830-FK_ToscaNodeTemplate_capabilitiesName.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | > upgrade 0840-FK_ToscaNodeTemplate_requirementsName.sql 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | > upgrade 0850-FK_ToscaNodeType_requirementsName.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | > upgrade 0860-FK_ToscaServiceTemplate_capabilityTypesName.sql 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | > upgrade 0870-FK_ToscaServiceTemplate_dataTypesName.sql 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:33:07.220+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | [2024-01-14T14:32:33.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 15, above threshold 10. 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:07.220+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 25766 ms 14:40:57 policy-db-migrator | > upgrade 0880-FK_ToscaServiceTemplate_nodeTypesName.sql 14:40:57 policy-pap | [2024-01-14T14:33:07.220+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | [2024-01-14T14:33:07.222+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | > upgrade 0890-FK_ToscaServiceTemplate_policyTypesName.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | > upgrade 0900-FK_ToscaServiceTemplate_relationshipTypesName.sql 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | > upgrade 0910-FK_ToscaTopologyTemplate_nodeTemplatesName.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-db-migrator | > upgrade 0920-FK_ToscaTopologyTemplate_policyName.sql 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | > upgrade 0940-PdpPolicyStatus_PdpGroup.sql 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:33:07.222+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | [2024-01-14T14:33:07.222+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:07.222+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | > upgrade 0950-TscaServiceTemplatetopologyTemplateParentLocalName.sql 14:40:57 policy-pap | [2024-01-14T14:33:12.227+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | [2024-01-14T14:33:12.227+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:34.998+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 16, above threshold 10. 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:12.227+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 26816 ms 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:33:12.228+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:12.228+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | > upgrade 0960-FK_ToscaNodeTemplate_capabilitiesName.sql 14:40:57 policy-pap | [2024-01-14T14:33:12.228+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | > upgrade 0970-FK_ToscaNodeTemplate_requirementsName.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | > upgrade 0980-FK_ToscaNodeType_requirementsName.sql 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | > upgrade 0990-FK_ToscaServiceTemplate_capabilityTypesName.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | > upgrade 1000-FK_ToscaServiceTemplate_dataTypesName.sql 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | > upgrade 1010-FK_ToscaServiceTemplate_nodeTypesName.sql 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | > upgrade 1020-FK_ToscaServiceTemplate_policyTypesName.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:36.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 17, above threshold 10. 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 27866 ms 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.098+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | > upgrade 1030-FK_ToscaServiceTemplate_relationshipTypesName.sql 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | > upgrade 1040-FK_ToscaTopologyTemplate_nodeTemplatesName.sql 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | > upgrade 1050-FK_ToscaTopologyTemplate_policyName.sql 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-db-migrator | > upgrade 1060-TscaServiceTemplatetopologyTemplateParentLocalName.sql 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-db-migrator | > upgrade 0100-pdp.sql 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | > upgrade 0110-idx_tsidx1.sql 14:40:57 policy-pap | [2024-01-14T14:33:27.228+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | [2024-01-14T14:33:32.233+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:32.233+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:33:32.233+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:32.233+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | > upgrade 0120-pk_pdpstatistics.sql 14:40:57 policy-pap | [2024-01-14T14:33:32.233+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:37.098+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 18, above threshold 10. 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:33:32.233+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 28916 ms 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:47.233+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.147+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.148+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | > upgrade 0130-pdpstatistics.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | > upgrade 0140-pk_pdpstatistics.sql 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | UPDATE 0 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | > upgrade 0150-pdpstatistics.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | > upgrade 0160-jpapdpstatistics_enginestats.sql 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | > upgrade 0170-jpapdpstatistics_enginestats.sql 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | UPDATE 0 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:47.233+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | > upgrade 0180-jpapdpstatistics_enginestats.sql 14:40:57 policy-pap | [2024-01-14T14:33:47.233+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:38.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 19, above threshold 10. 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 29966 ms 14:40:57 policy-db-migrator | > upgrade 0190-jpapolicyaudit.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.198+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | > upgrade 0200-JpaPolicyAuditIndex_timestamp.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | > upgrade 0210-sequence.sql 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | > upgrade 0220-sequence.sql 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | > upgrade 0100-jpatoscapolicy_targets.sql 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:47.233+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:33:47.234+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:47.234+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | > upgrade 0110-jpatoscapolicytype_targets.sql 14:40:57 policy-pap | [2024-01-14T14:33:47.234+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:33:47.234+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:33:47.234+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:33:47.235+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | > upgrade 0120-toscatrigger.sql 14:40:57 policy-pap | [2024-01-14T14:33:47.235+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | [2024-01-14T14:33:52.238+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:33:52.238+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | [2024-01-14T14:33:52.238+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | [2024-01-14T14:32:39.198+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 20, above threshold 10. 14:40:57 policy-pap | [2024-01-14T14:34:02.236+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-db-migrator | > upgrade 0130-jpatoscapolicytype_triggers.sql 14:40:57 policy-apex-pdp | [2024-01-14T14:32:40.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 31016 ms 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-apex-pdp | [2024-01-14T14:32:40.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | [2024-01-14T14:32:40.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | [2024-01-14T14:32:44.753+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | > upgrade 0140-toscaparameter.sql 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | > upgrade 0150-toscaproperty.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | > upgrade 0160-jpapolicyaudit_pk.sql 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-db-migrator | > upgrade 0170-pdpstatistics_pk.sql 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:34:02.236+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:34:02.236+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:34:02.236+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:34:02.237+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:34:02.237+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:44.754+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-db-migrator | > upgrade 0180-jpatoscanodetemplate_metadata.sql 14:40:57 policy-pap | [2024-01-14T14:34:02.237+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:44.754+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-pap | [2024-01-14T14:34:07.180+00:00|INFO|PdpModifyRequestMap|pool-5-thread-1] check for PDP records older than 360000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:44.754+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | [2024-01-14T14:34:07.238+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.252+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.252+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.252+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-db-migrator | > upgrade 0100-upgrade.sql 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.252+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-db-migrator | msg 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.252+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-db-migrator | --------------------------- 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-db-migrator | upgrade to 1100 completed 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | (1 row) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | > upgrade 0100-jpapolicyaudit_renameuser.sql 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | ALTER TABLE 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | > upgrade 0110-idx_tsidx1.sql 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | DROP INDEX 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | CREATE INDEX 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-db-migrator | > upgrade 0120-audit_sequence.sql 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | [2024-01-14T14:34:07.239+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-db-migrator | > upgrade 0130-statistics_sequence.sql 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | [2024-01-14T14:34:07.239+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | [2024-01-14T14:34:07.239+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:34:12.244+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.253+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | [2024-01-14T14:34:12.244+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:45.253+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 21, above threshold 10. 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:34:12.244+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 37066 ms 14:40:57 policy-db-migrator | > upgrade 0100-pdpstatistics.sql 14:40:57 policy-pap | [2024-01-14T14:34:17.237+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.298+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | > upgrade 0110-jpapdpstatistics_enginestats.sql 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | rc=0 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | > upgrade 0120-statistics_sequence.sql 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | DROP TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | INSERT 0 1 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | policyadmin: OK: upgrade (1300) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | List of databases 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | Name | Owner | Encoding | Collate | Ctype | ICU Locale | Locale Provider | Access privileges 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | -------------------+----------+----------+------------+------------+------------+-----------------+-------------------------- 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | clampacm | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | migration | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | operationshistory | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | [2024-01-14T14:34:17.238+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:34:17.238+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | policyadmin | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | [2024-01-14T14:34:17.238+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | [2024-01-14T14:34:17.239+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:34:17.239+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | [2024-01-14T14:34:17.239+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-db-migrator | policyclamp | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-apex-pdp | [2024-01-14T14:32:46.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 22, above threshold 10. 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 38116 ms 14:40:57 policy-pap | [2024-01-14T14:34:27.244+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-db-migrator | pooling | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =Tc/postgres + 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres + 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.348+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-db-migrator | | | | | | | | policy_user=CTc/postgres 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-db-migrator | postgres | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-db-migrator | template0 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =c/postgres + 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | template1 | postgres | UTF8 | en_US.utf8 | en_US.utf8 | | libc | =c/postgres + 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | | | | | | | | postgres=CTc/postgres 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | (9 rows) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | ?column? 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | ---------- 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | NOTICE: relation "schema_versions" already exists, skipping 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | CREATE TABLE 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | NOTICE: relation "policyadmin_schema_changelog" already exists, skipping 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | ?column? 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | ---------- 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | (0 rows) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | name | version 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | -------------+--------- 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | policyadmin | 1300 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | (1 row) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | [2024-01-14T14:34:27.245+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | id | script | operation | from_version | to_version | tag | success | attime 14:40:57 policy-pap | [2024-01-14T14:34:27.245+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | -----+---------------------------------------------------------------+-----------+--------------+------------+-------------------+---------+---------------------------- 14:40:57 policy-pap | [2024-01-14T14:34:27.245+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 1 | 0100-jpapdpgroup_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:39.919348 14:40:57 policy-pap | [2024-01-14T14:34:32.239+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | 2 | 0110-jpapdpstatistics_enginestats.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:39.93981 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:47.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 23, above threshold 10. 14:40:57 policy-db-migrator | 3 | 0120-jpapdpsubgroup_policies.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:39.960474 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 39166 ms 14:40:57 policy-db-migrator | 4 | 0130-jpapdpsubgroup_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:39.978001 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 5 | 0140-jpapdpsubgroup_supportedpolicytypes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.006236 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | 6 | 0150-jpatoscacapabilityassignment_attributes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.024762 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | 7 | 0160-jpatoscacapabilityassignment_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.048559 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.398+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | 8 | 0170-jpatoscacapabilityassignment_occurrences.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.066126 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | 9 | 0180-jpatoscacapabilityassignment_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.116863 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | 10 | 0190-jpatoscacapabilitytype_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.13736 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | 11 | 0200-jpatoscacapabilitytype_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.15587 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 12 | 0210-jpatoscadatatype_constraints.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.172935 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 13 | 0220-jpatoscadatatype_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.197927 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 14 | 0230-jpatoscadatatype_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.213059 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | 15 | 0240-jpatoscanodetemplate_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.232668 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 16 | 0250-jpatoscanodetemplate_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.251443 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 17 | 0260-jpatoscanodetype_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.270686 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 18 | 0270-jpatoscanodetype_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.290165 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 19 | 0280-jpatoscapolicy_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.307743 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | 20 | 0290-jpatoscapolicy_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.32718 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 21 | 0300-jpatoscapolicy_targets.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.340138 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | 22 | 0310-jpatoscapolicytype_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.35789 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 23 | 0320-jpatoscapolicytype_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.375444 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | 24 | 0330-jpatoscapolicytype_targets.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.391822 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | 25 | 0340-jpatoscapolicytype_triggers.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.407358 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | 26 | 0350-jpatoscaproperty_constraints.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.42733 14:40:57 policy-pap | [2024-01-14T14:34:32.240+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | 27 | 0360-jpatoscaproperty_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.450106 14:40:57 policy-pap | [2024-01-14T14:34:32.240+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | 28 | 0370-jpatoscarelationshiptype_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.475038 14:40:57 policy-pap | [2024-01-14T14:34:32.240+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | 29 | 0380-jpatoscarelationshiptype_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.494411 14:40:57 policy-pap | [2024-01-14T14:34:32.251+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | 30 | 0390-jpatoscarequirement_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.541977 14:40:57 policy-pap | [2024-01-14T14:34:32.251+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | 31 | 0400-jpatoscarequirement_occurrences.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.55999 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | 32 | 0410-jpatoscarequirement_properties.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.585156 14:40:57 policy-pap | [2024-01-14T14:34:32.251+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 33 | 0420-jpatoscaservicetemplate_metadata.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.606342 14:40:57 policy-pap | [2024-01-14T14:34:32.251+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | 34 | 0430-jpatoscatopologytemplate_inputs.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.624935 14:40:57 policy-pap | [2024-01-14T14:34:32.251+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | 35 | 0440-pdpgroup_pdpsubgroup.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.647959 14:40:57 policy-pap | [2024-01-14T14:34:32.252+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 36 | 0450-pdpgroup.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.672671 14:40:57 policy-pap | [2024-01-14T14:34:39.227+00:00|INFO|SessionData|http-nio-6969-exec-5] cache group defaultGroup 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | 37 | 0460-pdppolicystatus.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.694261 14:40:57 policy-pap | [2024-01-14T14:34:39.601+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-5] Registering a deploy for policy onap.policies.apex.pnf.Test 1.0.0 14:40:57 policy-apex-pdp | [2024-01-14T14:32:48.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 24, above threshold 10. 14:40:57 policy-pap | [2024-01-14T14:34:39.602+00:00|INFO|SessionData|http-nio-6969-exec-5] update cached group defaultGroup 14:40:57 policy-db-migrator | 38 | 0470-pdp.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.715443 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 40216 ms 14:40:57 policy-pap | [2024-01-14T14:34:39.602+00:00|INFO|SessionData|http-nio-6969-exec-5] updating DB group defaultGroup 14:40:57 policy-db-migrator | 39 | 0480-pdpstatistics.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.740191 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:34:39.622+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-5] sending audit records to database: [PolicyAudit(auditId=null, pdpGroup=defaultGroup, pdpType=apex, policy=onap.policies.apex.pnf.Test 1.0.0, action=DEPLOYMENT, timestamp=2024-01-14T14:34:39Z, user=policyadmin)] 14:40:57 policy-db-migrator | 40 | 0490-pdpsubgroup_pdp.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.767773 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-db-migrator | 41 | 0500-pdpsubgroup.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.789486 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.448+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | 42 | 0510-toscacapabilityassignment.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.81391 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | 43 | 0520-toscacapabilityassignments.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.832186 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-db-migrator | 44 | 0530-toscacapabilityassignments_toscacapabilityassignment.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.856439 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 45 | 0540-toscacapabilitytype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.880928 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 46 | 0550-toscacapabilitytypes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.901039 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 47 | 0560-toscacapabilitytypes_toscacapabilitytype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.945439 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | 48 | 0570-toscadatatype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:40.987251 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 49 | 0580-toscadatatypes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.007917 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 50 | 0590-toscadatatypes_toscadatatype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.029096 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 51 | 0600-toscanodetemplate.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.052138 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 52 | 0610-toscanodetemplates.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.072455 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | 53 | 0620-toscanodetemplates_toscanodetemplate.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.091269 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 54 | 0630-toscanodetype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.115092 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | 55 | 0640-toscanodetypes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.135097 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 56 | 0650-toscanodetypes_toscanodetype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.155755 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | 57 | 0660-toscaparameter.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.182885 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | 58 | 0670-toscapolicies.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.204354 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-db-migrator | 59 | 0680-toscapolicies_toscapolicy.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.224531 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-db-migrator | 60 | 0690-toscapolicy.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.248959 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-db-migrator | 61 | 0700-toscapolicytype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.274793 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-db-migrator | 62 | 0710-toscapolicytypes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.29612 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-db-migrator | 63 | 0720-toscapolicytypes_toscapolicytype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.31677 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-db-migrator | 64 | 0730-toscaproperty.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.364222 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-db-migrator | 65 | 0740-toscarelationshiptype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.390353 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 66 | 0750-toscarelationshiptypes.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.411789 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-db-migrator | 67 | 0760-toscarelationshiptypes_toscarelationshiptype.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.43233 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-db-migrator | 68 | 0770-toscarequirement.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.457421 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-db-migrator | 69 | 0780-toscarequirements.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.479291 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-db-migrator | 70 | 0790-toscarequirements_toscarequirement.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.498856 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-db-migrator | 71 | 0800-toscaservicetemplate.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.522114 14:40:57 policy-apex-pdp | [2024-01-14T14:32:49.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 25, above threshold 10. 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-db-migrator | 72 | 0810-toscatopologytemplate.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.54689 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 41266 ms 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 73 | 0820-toscatrigger.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.569204 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 74 | 0830-FK_ToscaNodeTemplate_capabilitiesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.590057 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 75 | 0840-FK_ToscaNodeTemplate_requirementsName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.61292 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.498+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | 76 | 0850-FK_ToscaNodeType_requirementsName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.631958 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 77 | 0860-FK_ToscaServiceTemplate_capabilityTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.652458 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 78 | 0870-FK_ToscaServiceTemplate_dataTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.670513 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 79 | 0880-FK_ToscaServiceTemplate_nodeTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.689512 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 80 | 0890-FK_ToscaServiceTemplate_policyTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.709394 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 81 | 0900-FK_ToscaServiceTemplate_relationshipTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.72912 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 82 | 0910-FK_ToscaTopologyTemplate_nodeTemplatesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.772347 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 83 | 0920-FK_ToscaTopologyTemplate_policyName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.793454 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 84 | 0940-PdpPolicyStatus_PdpGroup.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.813322 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 85 | 0950-TscaServiceTemplatetopologyTemplateParentLocalName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.833581 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 86 | 0960-FK_ToscaNodeTemplate_capabilitiesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.853674 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | 87 | 0970-FK_ToscaNodeTemplate_requirementsName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.875644 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 88 | 0980-FK_ToscaNodeType_requirementsName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.893451 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | 89 | 0990-FK_ToscaServiceTemplate_capabilityTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.91391 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 90 | 1000-FK_ToscaServiceTemplate_dataTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.933564 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | 91 | 1010-FK_ToscaServiceTemplate_nodeTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.953484 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | 92 | 1020-FK_ToscaServiceTemplate_policyTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.970967 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | 93 | 1030-FK_ToscaServiceTemplate_relationshipTypesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:41.989487 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | 94 | 1040-FK_ToscaTopologyTemplate_nodeTemplatesName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:42.006749 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | 95 | 1050-FK_ToscaTopologyTemplate_policyName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:42.022443 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-db-migrator | 96 | 1060-TscaServiceTemplatetopologyTemplateParentLocalName.sql | upgrade | 0 | 0800 | 1401241431390800u | 1 | 2024-01-14 14:31:42.043885 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-db-migrator | 97 | 0100-pdp.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.061927 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-db-migrator | 98 | 0110-idx_tsidx1.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.085208 14:40:57 policy-pap | [2024-01-14T14:34:47.252+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-db-migrator | 99 | 0120-pk_pdpstatistics.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.105355 14:40:57 policy-pap | [2024-01-14T14:34:52.259+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-db-migrator | 100 | 0130-pdpstatistics.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.125076 14:40:57 policy-pap | [2024-01-14T14:34:52.259+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-db-migrator | 101 | 0140-pk_pdpstatistics.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.149147 14:40:57 policy-pap | [2024-01-14T14:34:52.259+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-db-migrator | 102 | 0150-pdpstatistics.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.187298 14:40:57 policy-pap | [2024-01-14T14:34:52.259+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-db-migrator | 103 | 0160-jpapdpstatistics_enginestats.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.205761 14:40:57 policy-pap | [2024-01-14T14:34:52.259+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-db-migrator | 104 | 0170-jpapdpstatistics_enginestats.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.223757 14:40:57 policy-pap | [2024-01-14T14:34:52.259+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:32:50.498+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 26, above threshold 10. 14:40:57 policy-db-migrator | 105 | 0180-jpapdpstatistics_enginestats.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.242801 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 42316 ms 14:40:57 policy-db-migrator | 106 | 0190-jpapolicyaudit.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.268191 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-db-migrator | 107 | 0200-JpaPolicyAuditIndex_timestamp.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.289341 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-db-migrator | 108 | 0210-sequence.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.314682 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-db-migrator | 109 | 0220-sequence.sql | upgrade | 0800 | 0900 | 1401241431390900u | 1 | 2024-01-14 14:31:42.332345 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-db-migrator | 110 | 0100-jpatoscapolicy_targets.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.353617 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-db-migrator | 111 | 0110-jpatoscapolicytype_targets.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.373179 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-db-migrator | 112 | 0120-toscatrigger.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.392472 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-db-migrator | 113 | 0130-jpatoscapolicytype_triggers.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.416308 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-db-migrator | 114 | 0140-toscaparameter.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.436049 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-db-migrator | 115 | 0150-toscaproperty.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.459436 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-db-migrator | 116 | 0160-jpapolicyaudit_pk.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.482753 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-db-migrator | 117 | 0170-pdpstatistics_pk.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.509294 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-db-migrator | 118 | 0180-jpatoscanodetemplate_metadata.sql | upgrade | 0900 | 1000 | 1401241431391000u | 1 | 2024-01-14 14:31:42.527742 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-db-migrator | 119 | 0100-upgrade.sql | upgrade | 1000 | 1100 | 1401241431391100u | 1 | 2024-01-14 14:31:42.544879 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-db-migrator | 120 | 0100-jpapolicyaudit_renameuser.sql | upgrade | 1100 | 1200 | 1401241431391200u | 1 | 2024-01-14 14:31:42.563775 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-db-migrator | 121 | 0110-idx_tsidx1.sql | upgrade | 1100 | 1200 | 1401241431391200u | 1 | 2024-01-14 14:31:42.600934 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-db-migrator | 122 | 0120-audit_sequence.sql | upgrade | 1100 | 1200 | 1401241431391200u | 1 | 2024-01-14 14:31:42.625583 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-db-migrator | 123 | 0130-statistics_sequence.sql | upgrade | 1100 | 1200 | 1401241431391200u | 1 | 2024-01-14 14:31:42.651112 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-db-migrator | 124 | 0100-pdpstatistics.sql | upgrade | 1200 | 1300 | 1401241431391300u | 1 | 2024-01-14 14:31:42.671705 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-db-migrator | 125 | 0110-jpapdpstatistics_enginestats.sql | upgrade | 1200 | 1300 | 1401241431391300u | 1 | 2024-01-14 14:31:42.689024 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-db-migrator | 126 | 0120-statistics_sequence.sql | upgrade | 1200 | 1300 | 1401241431391300u | 1 | 2024-01-14 14:31:42.710648 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-db-migrator | (126 rows) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-db-migrator | 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-db-migrator | policyadmin: OK @ 1300 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:51.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 27, above threshold 10. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 43366 ms 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.597+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.598+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | [2024-01-14T14:35:07.260+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | [2024-01-14T14:35:12.265+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | [2024-01-14T14:35:12.265+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | [2024-01-14T14:35:12.265+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | [2024-01-14T14:35:12.265+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:35:12.265+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | [2024-01-14T14:35:12.265+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | [2024-01-14T14:35:27.265+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:52.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 28, above threshold 10. 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 44416 ms 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.648+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:35:27.265+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:53.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 29, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 45466 ms 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.698+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | [2024-01-14T14:35:27.266+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | [2024-01-14T14:35:27.266+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | [2024-01-14T14:35:27.266+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | [2024-01-14T14:35:27.266+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:35:27.266+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:35:27.266+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:35:32.273+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | [2024-01-14T14:35:32.273+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | [2024-01-14T14:35:32.273+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | [2024-01-14T14:35:32.273+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | [2024-01-14T14:35:32.273+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | [2024-01-14T14:35:32.273+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | [2024-01-14T14:35:47.273+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:54.698+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 30, above threshold 10. 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:55.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 46516 ms 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:55.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:55.747+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:32:56.090+00:00|INFO|RequestLog|qtp248710794-26] 172.17.0.3 - policyadmin [14/Jan/2024:14:32:56 +0000] "GET /metrics HTTP/1.1" 200 10649 "-" "Prometheus/2.48.1" 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.253+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.253+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.253+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.253+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.754+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.754+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.754+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.754+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.755+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | [2024-01-14T14:35:47.274+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | [2024-01-14T14:35:52.280+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | [2024-01-14T14:35:52.280+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:35:52.280+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:35:52.280+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | [2024-01-14T14:35:52.280+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | [2024-01-14T14:35:52.280+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | [2024-01-14T14:36:07.203+00:00|INFO|PdpModifyRequestMap|pool-5-thread-1] check for PDP records older than 360000ms 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | [2024-01-14T14:36:07.280+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.755+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:00.755+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 31, above threshold 10. 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 52566 ms 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.798+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:01.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 32, above threshold 10. 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 53616 ms 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.847+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.848+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | [2024-01-14T14:36:07.281+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | [2024-01-14T14:36:07.282+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | [2024-01-14T14:36:07.282+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:36:07.282+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:36:12.288+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | [2024-01-14T14:36:12.288+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | [2024-01-14T14:36:12.288+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:36:22.282+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:02.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 33, above threshold 10. 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 54666 ms 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.898+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | [2024-01-14T14:36:22.283+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | [2024-01-14T14:36:22.283+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | [2024-01-14T14:36:22.283+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | [2024-01-14T14:36:22.284+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | [2024-01-14T14:36:22.284+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:36:22.284+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:36:27.288+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:03.898+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 34, above threshold 10. 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 55716 ms 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.948+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | [2024-01-14T14:36:27.289+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | [2024-01-14T14:36:27.289+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | [2024-01-14T14:36:27.289+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | [2024-01-14T14:36:32.296+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | [2024-01-14T14:36:32.296+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | [2024-01-14T14:36:32.296+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | [2024-01-14T14:36:37.284+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:04.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 35, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 56766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.998+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:05.998+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 36, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 57816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.048+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:07.048+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 37, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 58866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:36:37.285+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:36:37.285+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:36:37.285+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:36:37.286+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:36:37.286+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:36:37.286+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:36:42.898+00:00|INFO|SessionData|http-nio-6969-exec-8] cache group defaultGroup 14:40:57 policy-pap | [2024-01-14T14:36:43.225+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-8] Registering a deploy for policy onap.policies.apex.vnf.Test 1.0.0 14:40:57 policy-pap | [2024-01-14T14:36:43.225+00:00|INFO|SessionData|http-nio-6969-exec-8] update cached group defaultGroup 14:40:57 policy-pap | [2024-01-14T14:36:43.225+00:00|INFO|SessionData|http-nio-6969-exec-8] updating DB group defaultGroup 14:40:57 policy-pap | [2024-01-14T14:36:43.241+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-8] sending audit records to database: [PolicyAudit(auditId=null, pdpGroup=defaultGroup, pdpType=apex, policy=onap.policies.apex.vnf.Test 1.0.0, action=DEPLOYMENT, timestamp=2024-01-14T14:36:43Z, user=policyadmin)] 14:40:57 policy-pap | [2024-01-14T14:36:47.296+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:36:47.297+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:36:47.297+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:36:47.297+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.098+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:08.098+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 38, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 59916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.148+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:09.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 39, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 60966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.198+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | [2024-01-14T14:36:52.286+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:36:52.286+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:36:52.286+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:36:52.287+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:36:52.303+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:36:52.303+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:36:52.303+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:36:52.303+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:36:52.303+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:36:52.303+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:37:07.303+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:37:07.304+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:37:12.307+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:37:12.307+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:37:12.307+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:37:12.308+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:37:12.308+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:37:12.308+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:10.198+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 40, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:11.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 62016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:11.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:11.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:15.755+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:15.755+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:33:15.755+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:15.755+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:37:27.308+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:37:27.309+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:37:32.315+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:37:32.315+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:37:32.315+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:37:32.315+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:37:32.315+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:37:32.315+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 41, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:16.252+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 68066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:17.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 42, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 69116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:37:47.316+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:37:52.321+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:37:52.321+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:37:52.321+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:37:52.321+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:37:52.321+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:37:52.321+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:38:07.223+00:00|INFO|PdpModifyRequestMap|pool-5-thread-1] check for PDP records older than 360000ms 14:40:57 policy-pap | [2024-01-14T14:38:07.321+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:18.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 43, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 70166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.398+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:19.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 44, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 71216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.448+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:38:07.321+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:38:07.322+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:38:07.322+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:38:07.322+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:38:07.322+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:38:07.322+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:38:07.322+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:38:12.329+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:38:12.329+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:38:12.329+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:38:12.329+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:38:12.329+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:38:12.329+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:20.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 45, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 72266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.498+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:21.498+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 46, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 73316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.548+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-pap | [2024-01-14T14:38:27.329+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:38:27.330+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:38:27.330+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:38:27.330+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:38:27.331+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:38:27.331+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:38:27.331+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:38:27.331+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:38:32.335+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:38:32.335+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:38:32.335+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:38:32.335+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:38:32.335+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:38:32.335+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:38:46.902+00:00|INFO|SessionData|http-nio-6969-exec-4] cache group defaultGroup 14:40:57 policy-pap | [2024-01-14T14:38:47.209+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-4] Registering a deploy for policy onap.policies.apex.pnf.metadataSet.Test 1.0.0 14:40:57 policy-pap | [2024-01-14T14:38:47.209+00:00|INFO|SessionData|http-nio-6969-exec-4] update cached group defaultGroup 14:40:57 policy-pap | [2024-01-14T14:38:47.209+00:00|INFO|SessionData|http-nio-6969-exec-4] updating DB group defaultGroup 14:40:57 policy-pap | [2024-01-14T14:38:47.224+00:00|INFO|PolicyAuditManager|http-nio-6969-exec-4] sending audit records to database: [PolicyAudit(auditId=null, pdpGroup=defaultGroup, pdpType=apex, policy=onap.policies.apex.pnf.metadataSet.Test 1.0.0, action=DEPLOYMENT, timestamp=2024-01-14T14:38:47Z, user=policyadmin)] 14:40:57 policy-pap | [2024-01-14T14:38:47.335+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:38:47.336+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:38:52.341+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:38:52.341+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:38:52.341+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:38:52.341+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:38:52.341+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:38:52.341+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:22.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 47, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 74366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.598+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:23.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 48, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.648+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 75417 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.649+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.649+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.651+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.652+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.652+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:24.652+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 49, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 76466 ms 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:39:07.342+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:39:12.348+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:39:12.348+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:39:12.348+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:39:12.348+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:39:12.348+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:39:12.348+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:39:27.348+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.697+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:25.698+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 50, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:26.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 77516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:26.747+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:26.747+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.253+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.254+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.254+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.254+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.753+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.753+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:39:27.349+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:39:32.357+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:39:32.357+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:39:32.357+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:39:32.357+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:39:32.357+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:39:32.357+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:39:47.357+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:39:47.357+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.753+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.753+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.753+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.754+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:31.754+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 51, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.798+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 83568 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.798+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.798+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.799+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.799+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.799+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:32.799+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 52, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.848+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 84617 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.848+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.848+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.849+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.849+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:39:47.357+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:39:47.357+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:39:47.357+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:39:47.358+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:39:47.358+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:39:47.358+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:39:52.362+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:39:52.362+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:39:52.362+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:39:52.362+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:39:52.362+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:39:52.362+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:40:07.236+00:00|INFO|PdpModifyRequestMap|pool-5-thread-1] check for PDP records older than 360000ms 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.849+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:33.849+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 53, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.897+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 85667 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.898+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.898+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.899+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:34.899+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 54, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.947+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 86717 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.948+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.948+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.949+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.949+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:40:07.363+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:40:12.369+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:40:12.369+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:40:12.369+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:40:12.369+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:40:12.369+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:40:12.369+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.949+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:35.949+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 55, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.997+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 87767 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.997+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.998+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.999+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:36.999+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 56, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.047+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 88817 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.047+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.048+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.048+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:40:27.369+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:40:27.370+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:40:32.374+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:40:32.374+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:40:32.374+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:40:32.374+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:40:32.374+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:40:32.374+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:40:47.375+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-heartbeat] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=policy-pap, consumerInstance=af94b0d0-2140-4786-9534-da1ebf22f1f9, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-heartbeat,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-heartbeat, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-pap | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-pap | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.049+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:38.049+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 57, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.097+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 89867 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.097+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.098+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.099+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.099+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:39.099+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 58, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 90916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.147+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.148+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:40:47.375+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-heartbeat] UEB GET /events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:40:47.375+00:00|WARN|HostSelector|DMAAP-source-policy-heartbeat] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:40:47.375+00:00|INFO|HttpClient|DMAAP-source-policy-heartbeat] GET http://message-router:3904/events/policy-pdp-pap/policy-pap/af94b0d0-2140-4786-9534-da1ebf22f1f9?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:40:47.375+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=a0acf4f8-a58c-4070-81f9-3f569a1b369a, consumerInstance=policy-pap, fetchTimeout=15000, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=15000], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-pap | java.net.UnknownHostException: message-router 14:40:57 policy-pap | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-pap | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-pap | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-pap | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-pap | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-pap | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-pap | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-pap | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-pap | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-pap | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-pap | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-pap | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-pap | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-pap | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-pap | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-pap | [2024-01-14T14:40:47.376+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 14:40:57 policy-pap | [2024-01-14T14:40:47.376+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-pap | [2024-01-14T14:40:47.377+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/a0acf4f8-a58c-4070-81f9-3f569a1b369a/policy-pap?timeout=15000 (anonymous) ... 14:40:57 policy-pap | [2024-01-14T14:40:52.382+00:00|WARN|HttpClient|DMAAP-source-policy-heartbeat] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:40:52.383+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router: Try again 14:40:57 policy-pap | [2024-01-14T14:40:52.383+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-pap | [2024-01-14T14:40:52.383+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-heartbeat] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-pap | [2024-01-14T14:40:52.383+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: cannot fetch because of message-router 14:40:57 policy-pap | [2024-01-14T14:40:52.383+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=15000]: backoff for 15000ms 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:40.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 59, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.197+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 91967 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.197+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.198+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:41.198+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 60, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:42.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 93016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:42.247+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:42.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:46.754+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:46.754+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:33:46.754+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:46.754+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.251+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.251+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.251+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.251+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.252+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.252+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:47.252+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 61, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 99066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.297+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.298+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:48.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 62, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 100116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:49.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 63, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 101166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.399+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:50.399+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 64, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 102216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.447+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.449+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.449+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.449+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:51.450+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 65, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 103266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.497+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.498+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.499+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:52.499+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 66, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 104316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.547+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.549+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.549+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.550+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:53.550+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 67, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 105366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.597+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.598+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.599+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:54.599+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 68, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 106416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.647+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.648+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.649+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:55.649+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 69, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.082+00:00|INFO|RequestLog|qtp248710794-28] 172.17.0.3 - policyadmin [14/Jan/2024:14:33:56 +0000] "GET /metrics HTTP/1.1" 200 10648 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 107466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.697+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.698+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.699+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.699+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:56.699+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 70, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:57.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 108516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:33:57.747+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:33:57.747+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.252+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.252+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.252+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.252+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.754+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.754+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.754+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.755+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.754+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.755+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:02.755+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 71, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 114566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:03.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 72, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.847+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 115617 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.847+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.847+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.848+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:04.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 73, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.897+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 116667 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.897+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.898+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:05.899+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 74, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.947+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 117717 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.947+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.948+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.949+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.949+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:06.949+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 75, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.997+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 118766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.997+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.998+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:07.998+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 76, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 1 msgs to /events/policy-pdp-pap. Oldest: 119816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.047+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.048+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 1 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.049+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 77, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:09.203+00:00|INFO|network|Timer-0] [OUT|DMAAP|policy-pdp-pap] 14:40:57 policy-apex-pdp | {"pdpType":"apex","state":"PASSIVE","healthy":"HEALTHY","description":"Pdp Heartbeat","messageName":"PDP_STATUS","requestId":"a8de8d0e-60cd-4b5e-8f4c-3de476091643","timestampMs":1705242849203,"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","pdpGroup":"defaultGroup"} 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 120866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.097+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:10.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 78, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 121916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.147+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.148+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:11.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 79, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 122966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.197+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.198+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.198+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:12.198+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 80, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:13.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 124016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:13.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:13.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:17.755+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:17.755+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:34:17.756+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:17.756+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.254+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.254+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.254+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.254+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.254+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.255+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:18.255+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 81, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 130066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.297+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.298+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:19.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 82, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 131116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.348+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:20.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 83, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 132166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.397+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.398+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:21.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 84, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 133216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:22.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 85, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 134266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.497+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.498+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:23.498+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 86, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 135316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.547+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.548+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:24.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 87, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 136366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:25.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 88, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 137416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.647+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.648+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:26.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 89, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 138466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.698+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.698+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:27.698+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 90, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:28.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 139516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:28.747+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:28.747+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.254+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.255+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.255+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.255+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.753+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.753+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.753+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.754+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.753+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.754+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:33.754+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 91, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 145566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:34.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 92, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 146616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:35.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 93, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 147666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:36.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 94, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.897+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 148667 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.897+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.898+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:37.898+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 95, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 149716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:38.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 96, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 150766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:39.998+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 97, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.047+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 151817 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.047+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.048+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.049+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:41.049+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 98, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.097+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 152867 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.097+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.098+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.099+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:42.100+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 99, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 153916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.147+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:43.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 100, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:44.197+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 154967 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:44.197+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:44.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:48.754+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:48.754+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:34:48.754+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:48.755+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.205+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.205+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.206+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.206+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 101, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.206+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.206+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:34:49.206+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 161016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.247+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.248+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:50.248+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 102, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 162066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.297+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.298+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:51.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 103, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 163116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:52.347+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 104, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 164166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.397+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:53.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 105, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 165216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.447+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.448+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:54.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 106, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 166266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.497+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.498+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:55.498+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 107, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.082+00:00|INFO|RequestLog|qtp248710794-33] 172.17.0.3 - policyadmin [14/Jan/2024:14:34:56 +0000] "GET /metrics HTTP/1.1" 200 10649 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.547+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 167316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.547+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.548+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.548+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.549+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:56.549+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 108, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 168366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.598+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:57.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 109, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 169416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.647+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.648+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:58.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 110, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:59.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 170466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:34:59.697+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:34:59.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.206+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.206+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.207+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.207+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.704+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.704+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.704+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.704+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.704+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:04.704+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 111, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.748+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 176516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.748+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.748+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.749+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.749+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.749+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:05.749+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 112, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 177566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:06.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 113, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 178616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.847+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.848+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.849+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:07.849+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 114, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 179666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:08.899+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 115, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 180716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.948+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:09.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 116, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.997+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 181767 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.997+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.998+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.999+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.999+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.999+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:10.999+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 117, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.047+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 182816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.047+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.048+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:12.048+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 118, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 183866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:13.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 119, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 184916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:14.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 120, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:15.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 185966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:15.197+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:15.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:19.704+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:19.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:35:19.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:19.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:20.203+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 121, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 192016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:21.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 122, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 193066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:22.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 123, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 194116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:23.347+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 124, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 195166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:24.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 125, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 196216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.448+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:25.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 126, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 197266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:26.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 127, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 198316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.547+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.548+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:27.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 128, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 199366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:28.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 129, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 200416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:29.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 130, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:30.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 201466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:30.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:30.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.203+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.204+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.204+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.204+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 131, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:35.703+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 207516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.747+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.748+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:36.748+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 132, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 208566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:37.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 133, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 209616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.847+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:38.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 134, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 210666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:39.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 135, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 211716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:40.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 136, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 212766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:41.998+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 137, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 213816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:43.048+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 138, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 214866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:44.098+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 139, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 215916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:45.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 140, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:46.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 216966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:46.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:46.196+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:50.703+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:50.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:35:50.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:50.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:51.202+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 141, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 223016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:52.248+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 142, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 224066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.298+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:53.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 143, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 225116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:54.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 144, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 226166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.396+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:55.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 145, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.081+00:00|INFO|RequestLog|qtp248710794-32] 172.17.0.3 - policyadmin [14/Jan/2024:14:35:56 +0000] "GET /metrics HTTP/1.1" 200 10649 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 227216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.448+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:56.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 146, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 228266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:57.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 147, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 229316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:58.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 148, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 230366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:35:59.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 149, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 231416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:00.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 150, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:01.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 232466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:01.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:01.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.203+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.203+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.203+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.203+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:06.703+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 151, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 238516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.748+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:07.748+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 152, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 2 msgs to /events/policy-pdp-pap. Oldest: 239566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 2 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:08.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 153, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.203+00:00|INFO|network|Timer-0] [OUT|DMAAP|policy-pdp-pap] 14:40:57 policy-apex-pdp | {"pdpType":"apex","state":"PASSIVE","healthy":"HEALTHY","description":"Pdp Heartbeat","messageName":"PDP_STATUS","requestId":"68a8ae0d-62e1-4a9a-8629-b2a4f42ffcf1","timestampMs":1705242969202,"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","pdpGroup":"defaultGroup"} 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 240616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.847+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.847+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.848+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:09.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 154, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 241666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.899+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.899+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:10.899+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 155, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 242716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.948+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:11.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 156, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 243766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:12.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 157, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 244816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:14.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 158, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 245866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:15.098+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 159, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 246916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:16.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 160, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:17.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 247966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:17.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:17.196+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:21.704+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:21.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:36:21.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:21.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 161, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:36:22.203+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 254016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:23.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 162, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 255066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.297+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:24.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 163, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 256116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:25.347+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 164, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 257166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.396+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:26.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 165, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 258216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.446+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:27.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 166, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 259266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:28.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 167, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 260316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:29.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 168, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 261366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:30.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 169, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 262416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:31.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 170, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:32.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 263466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:32.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:32.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.203+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.204+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.204+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.204+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:37.702+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 171, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 269516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:38.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 172, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 270566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:39.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 173, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 271616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:40.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 174, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 272666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.898+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:41.898+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 175, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 273716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:42.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 176, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 274766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:43.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 177, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 275816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:45.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 178, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 276866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:46.098+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 179, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 277916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:47.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 180, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:48.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 278966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:48.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:48.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:52.703+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:52.703+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:36:52.703+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:52.703+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.200+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.200+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.200+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.200+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 181, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.200+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.200+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:36:53.201+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 285016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.247+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.248+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:54.248+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 182, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 286066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.296+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:55.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 183, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.082+00:00|INFO|RequestLog|qtp248710794-29] 172.17.0.3 - policyadmin [14/Jan/2024:14:36:56 +0000] "GET /metrics HTTP/1.1" 200 10646 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 287116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.348+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:56.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 184, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 288166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:57.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 185, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 289216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:58.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 186, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 290266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:36:59.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 187, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 291316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:00.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 188, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 292366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:01.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 189, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 293416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:02.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 190, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:03.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 294466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:03.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:03.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.201+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.201+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.201+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.201+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:08.702+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 191, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 300516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:09.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 192, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 301566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:10.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 193, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 302616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:11.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 194, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 303666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:12.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 195, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 304716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:13.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 196, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 305766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.997+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.998+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:14.999+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 197, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 306816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.048+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:16.048+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 198, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 307866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.097+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.098+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.098+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:17.098+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 199, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 308916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.147+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:18.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 200, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:19.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 309966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:19.197+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:19.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:23.702+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:23.703+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:37:23.703+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:23.703+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:24.203+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 201, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 316016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:25.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 202, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 317066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:26.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 203, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 318116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:27.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 204, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.397+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 319166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.397+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.398+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:28.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 205, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 320216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:29.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 206, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 321266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:30.498+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 207, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 322316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:31.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 208, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 323366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:32.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 209, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 324416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:33.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 210, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:34.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 325466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:34.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:34.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.203+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.203+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.203+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.204+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.702+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.703+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.703+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:39.703+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 211, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.748+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 331516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.748+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.748+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.749+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.749+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.749+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:40.749+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 212, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 332566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.803+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.803+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.804+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.804+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:41.804+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 213, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 333616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:42.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 214, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 334666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:43.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 215, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 335716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:44.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 216, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 336766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:45.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 217, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 337816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:47.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 218, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 338866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:48.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 219, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 339916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:49.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 220, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:50.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 340966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:50.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:50.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:54.703+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:54.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:37:54.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:54.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.204+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.204+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.204+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.204+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 221, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.204+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:37:55.204+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.080+00:00|INFO|RequestLog|qtp248710794-31] 172.17.0.3 - policyadmin [14/Jan/2024:14:37:56 +0000] "GET /metrics HTTP/1.1" 200 10651 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 347016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:56.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 222, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 348066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.296+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:57.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 223, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 349116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:58.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 224, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 350166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.396+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:37:59.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 225, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 351216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.446+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:00.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 226, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 352266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:01.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 227, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 353316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:02.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 228, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 354366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:03.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 229, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 355416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:04.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 230, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:05.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 3 msgs to /events/policy-pdp-pap. Oldest: 356466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:05.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:05.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:09.202+00:00|INFO|network|Timer-0] [OUT|DMAAP|policy-pdp-pap] 14:40:57 policy-apex-pdp | {"pdpType":"apex","state":"PASSIVE","healthy":"HEALTHY","description":"Pdp Heartbeat","messageName":"PDP_STATUS","requestId":"b3119efc-51ca-46a4-8e81-9849744c10a2","timestampMs":1705243089202,"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","pdpGroup":"defaultGroup"} 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.204+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.204+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.204+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.205+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.703+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 3 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.703+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.703+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 231, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:10.704+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 362516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.748+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.748+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.748+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:11.748+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 232, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 363566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.798+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:12.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 233, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 364616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.848+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:13.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 234, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 365666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:14.898+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 235, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 366716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:15.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 236, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 367766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:16.998+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 237, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 368816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:18.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 238, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 369866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:19.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 239, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 370916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.148+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:20.148+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 240, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:21.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 371966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:21.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:21.196+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:25.704+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:25.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:38:25.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:25.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 241, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:38:26.201+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 378016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:27.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 242, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 379066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.296+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:28.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 243, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 380116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:29.347+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 244, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 381166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.396+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:30.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 245, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 382216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.446+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:31.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 246, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 383266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:32.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 247, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 384316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:33.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 248, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 385366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:34.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 249, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 386416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:35.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 250, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:36.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 387466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:36.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:36.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.201+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.202+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.202+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.203+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 251, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:38:41.703+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 393516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:42.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 252, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 394566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:43.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 253, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 395616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:44.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 254, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 396666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:45.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 255, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 397716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:46.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 256, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 398766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:47.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 257, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 399816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:49.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 258, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 400866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:50.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 259, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 401916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:51.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 260, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:52.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 402966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:52.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:52.196+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:56.079+00:00|INFO|RequestLog|qtp248710794-33] 172.17.0.3 - policyadmin [14/Jan/2024:14:38:56 +0000] "GET /metrics HTTP/1.1" 200 10649 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:38:56.704+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:56.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:38:56.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:56.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:57.203+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 261, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 409016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:58.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 262, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 410066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.296+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:38:59.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 263, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 411116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:00.347+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 264, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 412166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.396+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:01.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 265, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 413216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.446+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:02.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 266, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 414266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:03.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 267, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 415316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:04.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 268, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 416366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:05.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 269, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 417416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.647+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.647+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.648+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:06.648+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 270, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:07.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 418466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:07.699+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:07.699+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.203+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.203+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.204+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.204+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.705+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.705+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.706+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.706+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.706+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 271, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.706+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:39:12.706+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 424516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.747+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:13.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 272, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 425566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.797+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.797+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.798+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:14.798+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 273, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 426616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:15.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 274, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 427666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:16.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 275, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 428716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:17.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 276, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.997+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 429766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.998+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.998+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.998+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.998+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:18.999+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 277, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 430816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.047+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:20.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 278, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 431866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:21.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 279, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 432916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:22.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 280, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:23.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 433966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:23.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:23.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:27.707+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:27.707+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:39:27.707+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:27.707+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:28.203+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 281, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 440016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:29.247+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 282, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 441066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.296+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:30.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 283, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 442116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:31.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 284, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 443166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:32.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 285, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 444216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.446+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:33.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 286, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 445266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:34.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 287, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 446316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:35.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 288, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 447366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:36.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 289, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 448416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:37.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 290, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:38.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 449466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:38.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:38.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.203+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.204+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.204+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.204+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.703+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.703+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.703+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.703+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.703+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.704+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:43.704+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 291, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 455516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:44.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 292, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 456566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:45.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 293, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 457616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:46.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 294, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 458666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:47.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 295, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 459716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:48.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 296, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 460766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.997+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:49.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 297, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 461816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.048+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:51.048+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 298, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 462866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:52.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 299, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 463916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:53.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 300, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:54.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 464966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:54.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:54.196+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:56.079+00:00|INFO|RequestLog|qtp248710794-32] 172.17.0.3 - policyadmin [14/Jan/2024:14:39:56 +0000] "GET /metrics HTTP/1.1" 200 10646 "-" "Prometheus/2.48.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:39:58.703+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:58.704+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:39:58.704+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:58.704+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.204+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.203+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.204+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.204+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.204+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.204+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:39:59.204+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 301, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 471016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.246+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.247+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:00.248+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 302, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 472066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.296+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:01.297+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 303, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 473116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.346+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.347+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:02.347+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 304, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 474166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.396+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.397+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:03.397+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 305, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 475216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.446+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.447+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:04.447+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 306, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 476266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.496+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:05.497+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 307, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 477316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.546+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.547+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:06.547+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 308, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 478366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.596+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.596+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.597+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.597+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:07.597+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 309, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 4 msgs to /events/policy-pdp-pap. Oldest: 479416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 4 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:08.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 310, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:09.202+00:00|INFO|network|Timer-0] [OUT|DMAAP|policy-pdp-pap] 14:40:57 policy-apex-pdp | {"pdpType":"apex","state":"PASSIVE","healthy":"HEALTHY","description":"Pdp Heartbeat","messageName":"PDP_STATUS","requestId":"6ea69cf2-0cc2-4ceb-8924-7cca511de7cc","timestampMs":1705243209202,"name":"apex-420b334f-4cf7-4539-8e81-34c3865ae32e","pdpGroup":"defaultGroup"} 14:40:57 policy-apex-pdp | [2024-01-14T14:40:09.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 480466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:09.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:09.696+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.204+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.204+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.204+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.204+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.700+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.699+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.700+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.700+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.700+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 311, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.700+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:40:14.700+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 486516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:15.747+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 312, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 487566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:16.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 313, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 488616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:17.848+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 314, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 489666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.896+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:18.897+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 315, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 490716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.946+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:19.947+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 316, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 491766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:20.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 317, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 492816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:22.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 318, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 493866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.097+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:23.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 319, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 494916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:24.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 320, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:25.196+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 495966 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:25.196+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:25.197+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:29.700+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:29.701+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:40:29.701+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:29.701+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.201+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.202+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.202+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.202+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.202+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.202+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:30.202+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 321, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.246+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 502016 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.246+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.247+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.247+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.248+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:31.248+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 322, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.296+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 503066 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.296+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.297+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.297+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.297+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.298+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:32.298+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 323, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.346+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 504116 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.346+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.347+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.347+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.348+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:33.348+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 324, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.396+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 505166 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.396+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.397+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.397+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.398+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:34.398+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 325, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.446+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 506216 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.446+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.447+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.447+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.448+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:35.448+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 326, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.496+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 507266 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.496+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.497+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.497+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.497+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.498+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:36.498+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 327, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.546+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 508316 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.546+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.547+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.547+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.548+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:37.548+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 328, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.596+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 509366 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.597+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.597+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.598+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.598+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:38.598+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 329, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.646+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 510416 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.646+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.646+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.647+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.647+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:39.647+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 330, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:40.696+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 511466 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:40.696+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:40.697+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.202+00:00|ERROR|SingleThreadedBusTopicSource|DMAAP-source-policy-pdp-pap] SingleThreadedDmaapTopicSource [userName=null, password=-, getTopicCommInfrastructure()=DMAAP, toString()=SingleThreadedBusTopicSource [consumerGroup=72c8f796-b399-4b41-ab4e-44651d163818, consumerInstance=policy-apex-pdp, fetchTimeout=-1, fetchLimit=-1, consumer=CambriaConsumerWrapper [fetchTimeout=-1], alive=true, locked=false, uebThread=Thread[DMAAP-source-policy-pdp-pap,5,main], topicListeners=1, toString()=BusTopicBase [apiKey=null, apiSecret=null, useHttps=false, allowSelfSignedCerts=false, toString()=TopicBase [servers=[message-router], topic=policy-pdp-pap, effectiveTopic=policy-pdp-pap, #recentEvents=0, locked=false, #topicListeners=1]]]]: cannot fetch 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:887) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:384) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.get(HttpClient.java:368) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:87) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaConsumerImpl.fetch(CambriaConsumerImpl.java:64) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.BusConsumer$CambriaConsumerWrapper.fetch(BusConsumer.java:210) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.fetchAllMessages(SingleThreadedBusTopicSource.java:244) 14:40:57 policy-apex-pdp | at org.onap.policy.common.endpoints.event.comm.bus.internal.SingleThreadedBusTopicSource.run(SingleThreadedBusTopicSource.java:234) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.202+00:00|INFO|CambriaConsumerImpl|DMAAP-source-policy-pdp-pap] UEB GET /events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.202+00:00|WARN|HostSelector|DMAAP-source-policy-pdp-pap] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.203+00:00|INFO|HttpClient|DMAAP-source-policy-pdp-pap] GET http://message-router:3904/events/policy-pdp-pap/72c8f796-b399-4b41-ab4e-44651d163818/policy-apex-pdp (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.701+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.702+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router: Try again 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router: Try again 14:40:57 policy-apex-pdp | at java.base/java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:934) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1543) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:852) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.702+00:00|WARN|HttpClient|DMAAP-source-policy-pdp-pap] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.702+00:00|ERROR|BusConsumer$CambriaConsumerWrapper|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: cannot fetch because of message-router 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.702+00:00|INFO|BusConsumer$FetchingBusConsumer|DMAAP-source-policy-pdp-pap] CambriaConsumerWrapper [fetchTimeout=-1]: backoff for 15000ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.702+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:45.702+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 331, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.746+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 517516 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.746+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.746+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.747+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.747+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.748+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:46.748+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 332, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.796+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 518566 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.796+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.796+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.797+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.797+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:47.797+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 333, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.846+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 519616 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.846+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.846+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.847+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.847+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:48.847+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 334, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.896+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 520666 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.896+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.897+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.897+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.897+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.898+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.898+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 335, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:49.909+00:00|INFO|RequestLog|qtp248710794-29] 172.17.0.1 - policyadmin [14/Jan/2024:14:40:49 +0000] "GET /metrics?null HTTP/1.1" 200 11004 "-" "python-requests/2.27.1" 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.946+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 521716 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.946+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.947+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.947+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.947+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.948+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:50.948+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 336, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.996+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 522766 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.996+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.996+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.997+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.997+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:51.997+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 337, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.046+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 523816 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.046+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.046+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.047+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.047+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:53.047+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 338, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.096+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 524866 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.096+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.096+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.097+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.097+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:54.097+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 339, above threshold 10. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.146+00:00|INFO|CambriaSimplerBatchPublisher|pool-2-thread-1] sending 5 msgs to /events/policy-pdp-pap. Oldest: 525916 ms 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.146+00:00|WARN|HostSelector|pool-2-thread-1] All hosts were blacklisted; reverting to full set of hosts. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.146+00:00|INFO|HttpClient|pool-2-thread-1] POST http://message-router:3904/events/policy-pdp-pap (anonymous) ... 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.147+00:00|WARN|HttpClient|pool-2-thread-1] Unknown host message-router; blacklisting for 10 minutes 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] message-router 14:40:57 policy-apex-pdp | java.net.UnknownHostException: message-router 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress$CachedAddresses.get(InetAddress.java:801) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1533) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1385) 14:40:57 policy-apex-pdp | at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1306) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:112) 14:40:57 policy-apex-pdp | at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) 14:40:57 policy-apex-pdp | at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) 14:40:57 policy-apex-pdp | at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.runCall(HttpClient.java:708) 14:40:57 policy-apex-pdp | at com.att.nsa.apiClient.http.HttpClient.post(HttpClient.java:456) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.sendBatch(CambriaSimplerBatchPublisher.java:342) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.send(CambriaSimplerBatchPublisher.java:251) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher.access$100(CambriaSimplerBatchPublisher.java:31) 14:40:57 policy-apex-pdp | at com.att.nsa.cambria.client.impl.CambriaSimplerBatchPublisher$1.run(CambriaSimplerBatchPublisher.java:411) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 14:40:57 policy-apex-pdp | at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 14:40:57 policy-apex-pdp | at java.base/java.lang.Thread.run(Thread.java:840) 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.147+00:00|WARN|CambriaSimplerBatchPublisher|pool-2-thread-1] Send failed, 5 message to send. 14:40:57 policy-apex-pdp | [2024-01-14T14:40:55.147+00:00|ERROR|CambriaSimplerBatchPublisher|pool-2-thread-1] PUB_CHRONIC_FAILURE: Send failure count is 340, above threshold 10. 14:40:57 ++ echo 'Tearing down containers...' 14:40:57 Tearing down containers... 14:40:57 ++ docker-compose down -v --remove-orphans 14:40:58 Stopping policy-apex-pdp ... 14:40:58 Stopping policy-pap ... 14:40:58 Stopping policy-api ... 14:40:58 Stopping prometheus ... 14:40:58 Stopping prometheus ... done 14:41:08 Stopping policy-apex-pdp ... done 14:41:18 Stopping policy-pap ... done 14:41:29 Stopping policy-api ... done 14:41:29 Removing orphan container "postgres" 14:41:29 Removing policy-apex-pdp ... 14:41:29 Removing policy-pap ... 14:41:29 Removing policy-api ... 14:41:29 Removing policy-db-migrator ... 14:41:29 Removing simulator ... 14:41:29 Removing prometheus ... 14:41:29 Removing policy-db-migrator ... done 14:41:29 Removing policy-api ... done 14:41:29 Removing prometheus ... done 14:41:29 Removing policy-apex-pdp ... done 14:41:29 Removing simulator ... done 14:41:29 Removing policy-pap ... done 14:41:29 Removing network compose_default 14:41:29 ++ cd /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres 14:41:29 + load_set 14:41:29 + _setopts=hxB 14:41:29 ++ echo braceexpand:hashall:interactive-comments:xtrace 14:41:29 ++ tr : ' ' 14:41:29 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:41:29 + set +o braceexpand 14:41:29 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:41:29 + set +o hashall 14:41:29 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:41:29 + set +o interactive-comments 14:41:29 + for i in $(echo "${SHELLOPTS}" | tr ':' ' ') 14:41:29 + set +o xtrace 14:41:29 ++ echo hxB 14:41:29 ++ sed 's/./& /g' 14:41:29 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:41:29 + set +h 14:41:29 + for i in $(echo "$_setopts" | sed 's/./& /g') 14:41:29 + set +x 14:41:29 + [[ -n /tmp/tmp.BrktwiWmQ3 ]] 14:41:29 + rsync -av /tmp/tmp.BrktwiWmQ3/ /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/csit/archives/apex-pdp-postgres 14:41:29 sending incremental file list 14:41:29 ./ 14:41:29 log.html 14:41:29 output.xml 14:41:29 report.html 14:41:29 testplan.txt 14:41:29 14:41:29 sent 2,206,468 bytes received 95 bytes 4,413,126.00 bytes/sec 14:41:29 total size is 2,205,609 speedup is 1.00 14:41:29 + rm -rf /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/models 14:41:29 + exit 5 14:41:29 Build step 'Execute shell' marked build as failure 14:41:29 $ ssh-agent -k 14:41:29 unset SSH_AUTH_SOCK; 14:41:29 unset SSH_AGENT_PID; 14:41:29 echo Agent pid 2100 killed; 14:41:29 [ssh-agent] Stopped. 14:41:30 Robot results publisher started... 14:41:30 -Parsing output xml: 14:41:30 Done! 14:41:30 WARNING! Could not find file: **/log.html 14:41:30 WARNING! Could not find file: **/report.html 14:41:30 -Copying log files to build dir: 14:41:30 Done! 14:41:30 -Assigning results to build: 14:41:30 Done! 14:41:30 -Checking thresholds: 14:41:30 Done! 14:41:30 Done publishing Robot results. 14:41:30 [PostBuildScript] - [INFO] Executing post build scripts. 14:41:30 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins2330278013365087195.sh 14:41:30 ---> sysstat.sh 14:41:31 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins1870180530225404702.sh 14:41:31 ---> package-listing.sh 14:41:31 ++ facter osfamily 14:41:31 ++ tr '[:upper:]' '[:lower:]' 14:41:31 + OS_FAMILY=debian 14:41:31 + workspace=/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres 14:41:31 + START_PACKAGES=/tmp/packages_start.txt 14:41:31 + END_PACKAGES=/tmp/packages_end.txt 14:41:31 + DIFF_PACKAGES=/tmp/packages_diff.txt 14:41:31 + PACKAGES=/tmp/packages_start.txt 14:41:31 + '[' /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:41:31 + PACKAGES=/tmp/packages_end.txt 14:41:31 + case "${OS_FAMILY}" in 14:41:31 + dpkg -l 14:41:31 + grep '^ii' 14:41:31 + '[' -f /tmp/packages_start.txt ']' 14:41:31 + '[' -f /tmp/packages_end.txt ']' 14:41:31 + diff /tmp/packages_start.txt /tmp/packages_end.txt 14:41:31 + '[' /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres ']' 14:41:31 + mkdir -p /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/archives/ 14:41:31 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/archives/ 14:41:31 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins966377158525946276.sh 14:41:31 ---> capture-instance-metadata.sh 14:41:31 Setup pyenv: 14:41:31 system 14:41:31 3.8.13 14:41:31 3.9.13 14:41:31 * 3.10.6 (set by /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/.python-version) 14:41:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jG55 from file:/tmp/.os_lf_venv 14:41:33 lf-activate-venv(): INFO: Installing: lftools 14:41:43 lf-activate-venv(): INFO: Adding /tmp/venv-jG55/bin to PATH 14:41:43 INFO: Running in OpenStack, capturing instance metadata 14:41:44 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins12080781864389585676.sh 14:41:44 provisioning config files... 14:41:44 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres@tmp/config8268414622172148618tmp 14:41:44 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 14:41:44 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 14:41:44 [EnvInject] - Injecting environment variables from a build step. 14:41:44 [EnvInject] - Injecting as environment variables the properties content 14:41:44 SERVER_ID=logs 14:41:44 14:41:44 [EnvInject] - Variables injected successfully. 14:41:44 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins751751093691142377.sh 14:41:44 ---> create-netrc.sh 14:41:44 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins13522561206224701509.sh 14:41:44 ---> python-tools-install.sh 14:41:44 Setup pyenv: 14:41:44 system 14:41:44 3.8.13 14:41:44 3.9.13 14:41:44 * 3.10.6 (set by /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/.python-version) 14:41:44 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jG55 from file:/tmp/.os_lf_venv 14:41:45 lf-activate-venv(): INFO: Installing: lftools 14:41:53 lf-activate-venv(): INFO: Adding /tmp/venv-jG55/bin to PATH 14:41:53 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins4465141941370139807.sh 14:41:53 ---> sudo-logs.sh 14:41:53 Archiving 'sudo' log.. 14:41:53 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash /tmp/jenkins2202355741636989513.sh 14:41:53 ---> job-cost.sh 14:41:53 Setup pyenv: 14:41:53 system 14:41:53 3.8.13 14:41:53 3.9.13 14:41:53 * 3.10.6 (set by /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/.python-version) 14:41:53 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jG55 from file:/tmp/.os_lf_venv 14:41:55 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 14:42:01 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 14:42:01 lftools 0.37.8 requires openstacksdk<1.5.0, but you have openstacksdk 2.1.0 which is incompatible. 14:42:01 lf-activate-venv(): INFO: Adding /tmp/venv-jG55/bin to PATH 14:42:01 INFO: No Stack... 14:42:02 INFO: Retrieving Pricing Info for: v3-standard-8 14:42:02 INFO: Archiving Costs 14:42:02 [policy-apex-pdp-master-project-csit-apex-pdp-postgres] $ /bin/bash -l /tmp/jenkins15788341832346496018.sh 14:42:02 ---> logs-deploy.sh 14:42:02 Setup pyenv: 14:42:02 system 14:42:02 3.8.13 14:42:02 3.9.13 14:42:02 * 3.10.6 (set by /w/workspace/policy-apex-pdp-master-project-csit-apex-pdp-postgres/.python-version) 14:42:02 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-jG55 from file:/tmp/.os_lf_venv 14:42:04 lf-activate-venv(): INFO: Installing: lftools 14:42:12 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 14:42:12 python-openstackclient 6.4.0 requires openstacksdk>=2.0.0, but you have openstacksdk 1.4.0 which is incompatible. 14:42:12 lf-activate-venv(): INFO: Adding /tmp/venv-jG55/bin to PATH 14:42:12 INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/policy-apex-pdp-master-project-csit-apex-pdp-postgres/328 14:42:12 INFO: archiving workspace using pattern(s): -p **/target/surefire-reports/*-output.txt 14:42:13 Archives upload complete. 14:42:14 INFO: archiving logs to Nexus 14:42:14 ---> uname -a: 14:42:14 Linux prd-ubuntu1804-docker-8c-8g-12198 4.15.0-192-generic #203-Ubuntu SMP Wed Aug 10 17:40:03 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux 14:42:14 14:42:14 14:42:14 ---> lscpu: 14:42:14 Architecture: x86_64 14:42:14 CPU op-mode(s): 32-bit, 64-bit 14:42:14 Byte Order: Little Endian 14:42:14 CPU(s): 8 14:42:14 On-line CPU(s) list: 0-7 14:42:14 Thread(s) per core: 1 14:42:14 Core(s) per socket: 1 14:42:14 Socket(s): 8 14:42:14 NUMA node(s): 1 14:42:14 Vendor ID: AuthenticAMD 14:42:14 CPU family: 23 14:42:14 Model: 49 14:42:14 Model name: AMD EPYC-Rome Processor 14:42:14 Stepping: 0 14:42:14 CPU MHz: 2800.000 14:42:14 BogoMIPS: 5600.00 14:42:14 Virtualization: AMD-V 14:42:14 Hypervisor vendor: KVM 14:42:14 Virtualization type: full 14:42:14 L1d cache: 32K 14:42:14 L1i cache: 32K 14:42:14 L2 cache: 512K 14:42:14 L3 cache: 16384K 14:42:14 NUMA node0 CPU(s): 0-7 14:42:14 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl xtopology cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr arat npt nrip_save umip rdpid arch_capabilities 14:42:14 14:42:14 14:42:14 ---> nproc: 14:42:14 8 14:42:14 14:42:14 14:42:14 ---> df -h: 14:42:14 Filesystem Size Used Avail Use% Mounted on 14:42:14 udev 16G 0 16G 0% /dev 14:42:14 tmpfs 3.2G 708K 3.2G 1% /run 14:42:14 /dev/vda1 155G 13G 143G 8% / 14:42:14 tmpfs 16G 0 16G 0% /dev/shm 14:42:14 tmpfs 5.0M 0 5.0M 0% /run/lock 14:42:14 tmpfs 16G 0 16G 0% /sys/fs/cgroup 14:42:14 /dev/vda15 105M 4.4M 100M 5% /boot/efi 14:42:14 tmpfs 3.2G 0 3.2G 0% /run/user/1001 14:42:14 14:42:14 14:42:14 ---> free -m: 14:42:14 total used free shared buff/cache available 14:42:14 Mem: 32167 857 26485 0 4823 30853 14:42:14 Swap: 1023 0 1023 14:42:14 14:42:14 14:42:14 ---> ip addr: 14:42:14 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 14:42:14 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 14:42:14 inet 127.0.0.1/8 scope host lo 14:42:14 valid_lft forever preferred_lft forever 14:42:14 inet6 ::1/128 scope host 14:42:14 valid_lft forever preferred_lft forever 14:42:14 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 14:42:14 link/ether fa:16:3e:e0:92:84 brd ff:ff:ff:ff:ff:ff 14:42:14 inet 10.30.106.49/23 brd 10.30.107.255 scope global dynamic ens3 14:42:14 valid_lft 85565sec preferred_lft 85565sec 14:42:14 inet6 fe80::f816:3eff:fee0:9284/64 scope link 14:42:14 valid_lft forever preferred_lft forever 14:42:14 3: docker0: mtu 1500 qdisc noqueue state DOWN group default 14:42:14 link/ether 02:42:6a:06:08:09 brd ff:ff:ff:ff:ff:ff 14:42:14 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 14:42:14 valid_lft forever preferred_lft forever 14:42:14 14:42:14 14:42:14 ---> sar -b -r -n DEV: 14:42:14 Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-12198) 01/14/24 _x86_64_ (8 CPU) 14:42:14 14:42:14 14:28:22 LINUX RESTART (8 CPU) 14:42:14 14:42:14 14:29:01 tps rtps wtps bread/s bwrtn/s 14:42:14 14:30:01 103.07 22.20 80.87 1139.41 26669.16 14:42:14 14:31:01 135.24 23.08 112.16 2777.61 32687.37 14:42:14 14:32:01 290.09 2.72 287.37 433.06 107848.32 14:42:14 14:33:01 17.60 0.53 17.06 22.80 19384.10 14:42:14 14:34:01 16.08 0.00 16.08 0.00 19714.18 14:42:14 14:35:01 16.73 0.00 16.73 0.00 19600.00 14:42:14 14:36:01 14.80 0.00 14.80 0.00 19695.25 14:42:14 14:37:01 10.33 0.00 10.33 0.00 5139.94 14:42:14 14:38:01 8.88 0.00 8.88 0.00 141.98 14:42:14 14:39:01 4.42 0.00 4.42 0.00 111.98 14:42:14 14:40:01 2.52 0.00 2.52 0.00 58.12 14:42:14 14:41:01 6.77 0.00 6.77 0.00 1105.15 14:42:14 14:42:01 39.23 1.42 37.81 107.58 2385.60 14:42:14 Average: 51.21 3.84 47.37 344.68 19581.39 14:42:14 14:42:14 14:29:01 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 14:42:14 14:30:01 30063360 31694768 2875860 8.73 71396 1868348 1394224 4.10 880564 1701580 183856 14:42:14 14:31:01 28575140 31655188 4364080 13.25 104720 3236644 1535960 4.52 998908 2975672 1167844 14:42:14 14:32:01 25976996 30571748 6962224 21.14 117208 4688836 4302384 12.66 2171104 4296160 1304 14:42:14 14:33:01 25735832 30334536 7203388 21.87 117336 4691852 4748428 13.97 2427144 4273692 132 14:42:14 14:34:01 25729720 30329504 7209500 21.89 117428 4693164 4764772 14.02 2431376 4274636 556 14:42:14 14:35:01 25712388 30313344 7226832 21.94 117516 4694192 4781072 14.07 2447912 4274620 324 14:42:14 14:36:01 25710952 30313028 7228268 21.94 117592 4695068 4764884 14.02 2448192 4275500 460 14:42:14 14:37:01 25695284 30298588 7243936 21.99 117664 4696172 4764724 14.02 2463600 4276224 56 14:42:14 14:38:01 25688100 30292204 7251120 22.01 117736 4696824 4780896 14.07 2469904 4276472 456 14:42:14 14:39:01 25675644 30281084 7263576 22.05 117808 4698116 4800012 14.12 2481780 4277324 384 14:42:14 14:40:01 25669596 30275784 7269624 22.07 117852 4698796 4816092 14.17 2486684 4277988 452 14:42:14 14:41:01 25641708 30278624 7297512 22.15 118064 4728240 4584000 13.49 2496840 4295724 220 14:42:14 14:42:01 27108100 31580028 5831120 17.70 122072 4552008 1505056 4.43 1227612 4141856 29064 14:42:14 Average: 26383294 30632187 6555926 19.90 113415 4356789 3964808 11.67 2110125 3970573 106547 14:42:14 14:42:14 14:29:01 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 14:42:14 14:30:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:30:01 ens3 66.67 44.26 1068.47 8.44 0.00 0.00 0.00 0.00 14:42:14 14:30:01 lo 1.47 1.47 0.16 0.16 0.00 0.00 0.00 0.00 14:42:14 14:31:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:31:01 ens3 327.21 199.43 10417.21 18.24 0.00 0.00 0.00 0.00 14:42:14 14:31:01 lo 7.86 7.86 0.73 0.73 0.00 0.00 0.00 0.00 14:42:14 14:31:01 br-b3e647082e00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:32:01 veth22428df 101.47 101.20 16.89 19.28 0.00 0.00 0.00 0.00 14:42:14 14:32:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:32:01 veth815b1ff 1.62 1.70 0.19 0.16 0.00 0.00 0.00 0.00 14:42:14 14:32:01 ens3 325.94 167.34 11351.12 11.95 0.00 0.00 0.00 0.00 14:42:14 14:33:01 veth22428df 39.71 39.53 9.74 15.08 0.00 0.00 0.00 0.00 14:42:14 14:33:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:33:01 veth815b1ff 41.98 40.94 5.58 11.21 0.00 0.00 0.00 0.00 14:42:14 14:33:01 ens3 4.12 3.43 0.97 1.12 0.00 0.00 0.00 0.00 14:42:14 14:34:01 veth22428df 0.27 0.28 0.57 0.02 0.00 0.00 0.00 0.00 14:42:14 14:34:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:34:01 veth815b1ff 1.97 1.80 0.86 0.19 0.00 0.00 0.00 0.00 14:42:14 14:34:01 ens3 0.62 0.62 0.16 0.29 0.00 0.00 0.00 0.00 14:42:14 14:35:01 veth22428df 41.07 40.32 7.67 13.71 0.00 0.00 0.00 0.00 14:42:14 14:35:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:35:01 veth815b1ff 43.35 42.04 5.48 12.47 0.00 0.00 0.00 0.00 14:42:14 14:35:01 ens3 0.65 0.67 0.11 0.32 0.00 0.00 0.00 0.00 14:42:14 14:36:01 veth22428df 0.27 0.28 0.57 0.02 0.00 0.00 0.00 0.00 14:42:14 14:36:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:36:01 veth815b1ff 2.22 2.03 0.90 0.21 0.00 0.00 0.00 0.00 14:42:14 14:36:01 ens3 0.50 0.48 0.09 0.24 0.00 0.00 0.00 0.00 14:42:14 14:37:01 veth22428df 42.79 41.76 8.32 15.44 0.00 0.00 0.00 0.00 14:42:14 14:37:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:37:01 veth815b1ff 44.84 43.16 5.52 14.01 0.00 0.00 0.00 0.00 14:42:14 14:37:01 ens3 5.10 2.13 5.28 0.35 0.00 0.00 0.00 0.00 14:42:14 14:38:01 veth22428df 0.25 0.25 0.57 0.02 0.00 0.00 0.00 0.00 14:42:14 14:38:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:38:01 veth815b1ff 2.23 2.05 0.90 0.21 0.00 0.00 0.00 0.00 14:42:14 14:38:01 ens3 0.45 0.55 0.08 0.06 0.00 0.00 0.00 0.00 14:42:14 14:39:01 veth22428df 89.15 86.19 12.96 30.37 0.00 0.00 0.00 0.00 14:42:14 14:39:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:39:01 veth815b1ff 47.06 45.08 5.75 15.47 0.00 0.00 0.00 0.00 14:42:14 14:39:01 ens3 0.72 0.68 0.18 0.28 0.00 0.00 0.00 0.00 14:42:14 14:40:01 veth22428df 0.27 0.28 0.57 0.02 0.00 0.00 0.00 0.00 14:42:14 14:40:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:40:01 veth815b1ff 2.23 2.03 0.90 0.21 0.00 0.00 0.00 0.00 14:42:14 14:40:01 ens3 0.47 0.45 0.08 0.10 0.00 0.00 0.00 0.00 14:42:14 14:41:01 veth22428df 0.35 0.37 0.58 0.03 0.00 0.00 0.00 0.00 14:42:14 14:41:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:41:01 veth815b1ff 3.95 3.97 1.00 0.38 0.00 0.00 0.00 0.00 14:42:14 14:41:01 ens3 22.11 18.55 7.85 40.75 0.00 0.00 0.00 0.00 14:42:14 14:42:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 14:42:01 ens3 56.92 37.29 115.18 21.44 0.00 0.00 0.00 0.00 14:42:14 14:42:01 lo 126.20 126.20 30.93 30.93 0.00 0.00 0.00 0.00 14:42:14 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 14:42:14 Average: ens3 62.43 36.61 1766.89 7.97 0.00 0.00 0.00 0.00 14:42:14 Average: lo 9.40 9.40 2.35 2.35 0.00 0.00 0.00 0.00 14:42:14 14:42:14 14:42:14 ---> sar -P ALL: 14:42:14 Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-12198) 01/14/24 _x86_64_ (8 CPU) 14:42:14 14:42:14 14:28:22 LINUX RESTART (8 CPU) 14:42:14 14:42:14 14:29:01 CPU %user %nice %system %iowait %steal %idle 14:42:14 14:30:01 all 10.24 0.00 0.73 1.94 0.03 87.06 14:42:14 14:30:01 0 0.67 0.00 0.07 0.32 0.03 98.91 14:42:14 14:30:01 1 2.90 0.00 0.37 0.05 0.02 96.66 14:42:14 14:30:01 2 25.00 0.00 1.67 12.89 0.07 60.37 14:42:14 14:30:01 3 19.48 0.00 0.95 0.90 0.03 78.63 14:42:14 14:30:01 4 18.22 0.00 1.07 0.58 0.03 80.09 14:42:14 14:30:01 5 1.08 0.00 0.32 0.00 0.00 98.60 14:42:14 14:30:01 6 3.59 0.00 0.57 0.22 0.03 95.60 14:42:14 14:30:01 7 10.97 0.00 0.83 0.55 0.03 87.61 14:42:14 14:31:01 all 10.95 0.00 2.25 2.77 0.04 83.99 14:42:14 14:31:01 0 5.00 0.00 1.80 1.39 0.07 91.75 14:42:14 14:31:01 1 10.18 0.00 1.61 0.74 0.03 87.43 14:42:14 14:31:01 2 6.86 0.00 2.04 13.68 0.05 77.38 14:42:14 14:31:01 3 20.28 0.00 2.85 0.57 0.05 76.25 14:42:14 14:31:01 4 4.91 0.00 1.83 2.72 0.03 90.50 14:42:14 14:31:01 5 4.10 0.00 2.00 0.03 0.03 93.83 14:42:14 14:31:01 6 23.61 0.00 3.00 1.64 0.05 71.70 14:42:14 14:31:01 7 12.55 0.00 2.90 1.39 0.03 83.13 14:42:14 14:32:01 all 19.96 0.00 4.48 5.51 0.07 69.99 14:42:14 14:32:01 0 18.70 0.00 5.33 27.14 0.07 48.76 14:42:14 14:32:01 1 18.93 0.00 4.64 0.50 0.07 75.86 14:42:14 14:32:01 2 18.73 0.00 3.78 10.03 0.07 67.39 14:42:14 14:32:01 3 17.57 0.00 4.49 2.83 0.05 75.05 14:42:14 14:32:01 4 20.41 0.00 4.57 2.28 0.07 72.68 14:42:14 14:32:01 5 27.49 0.00 5.28 0.61 0.07 66.55 14:42:14 14:32:01 6 14.63 0.00 3.03 0.45 0.07 81.82 14:42:14 14:32:01 7 23.27 0.00 4.68 0.32 0.07 71.66 14:42:14 14:33:01 all 8.80 0.00 0.82 1.05 0.04 89.30 14:42:14 14:33:01 0 6.64 0.00 0.48 0.00 0.05 92.83 14:42:14 14:33:01 1 7.42 0.00 0.75 0.00 0.05 91.78 14:42:14 14:33:01 2 10.62 0.00 1.10 3.41 0.03 84.84 14:42:14 14:33:01 3 10.03 0.00 0.77 0.00 0.03 89.17 14:42:14 14:33:01 4 11.25 0.00 0.85 0.00 0.03 87.86 14:42:14 14:33:01 5 10.20 0.00 0.88 4.92 0.02 83.98 14:42:14 14:33:01 6 5.67 0.00 0.77 0.02 0.05 93.49 14:42:14 14:33:01 7 8.51 0.00 0.92 0.00 0.05 90.51 14:42:14 14:34:01 all 0.50 0.00 0.11 0.96 0.03 98.40 14:42:14 14:34:01 0 0.25 0.00 0.15 0.02 0.05 99.53 14:42:14 14:34:01 1 0.48 0.00 0.12 0.00 0.05 99.35 14:42:14 14:34:01 2 0.37 0.00 0.03 0.05 0.02 99.53 14:42:14 14:34:01 3 0.27 0.00 0.07 0.00 0.00 99.67 14:42:14 14:34:01 4 0.92 0.00 0.25 0.00 0.03 98.80 14:42:14 14:34:01 5 0.68 0.00 0.05 7.61 0.02 91.64 14:42:14 14:34:01 6 0.33 0.00 0.12 0.02 0.03 99.50 14:42:14 14:34:01 7 0.72 0.00 0.12 0.02 0.03 99.12 14:42:14 14:35:01 all 1.62 0.00 0.22 0.93 0.03 97.21 14:42:14 14:35:01 0 1.75 0.00 0.40 0.00 0.05 97.80 14:42:14 14:35:01 1 1.47 0.00 0.23 0.00 0.05 98.25 14:42:14 14:35:01 2 1.47 0.00 0.15 0.00 0.02 98.37 14:42:14 14:35:01 3 2.02 0.00 0.18 0.00 0.02 97.78 14:42:14 14:35:01 4 1.83 0.00 0.18 0.00 0.03 97.95 14:42:14 14:35:01 5 2.00 0.00 0.15 7.36 0.03 90.45 14:42:14 14:35:01 6 1.05 0.00 0.33 0.03 0.02 98.56 14:42:14 14:35:01 7 1.35 0.00 0.12 0.02 0.03 98.48 14:42:14 14:36:01 all 0.64 0.00 0.09 1.00 0.03 98.23 14:42:14 14:36:01 0 0.47 0.00 0.07 0.00 0.07 99.40 14:42:14 14:36:01 1 0.27 0.00 0.03 0.00 0.02 99.68 14:42:14 14:36:01 2 0.28 0.00 0.07 0.00 0.02 99.63 14:42:14 14:36:01 3 0.83 0.00 0.22 0.02 0.03 98.90 14:42:14 14:36:01 4 0.70 0.00 0.10 0.00 0.05 99.15 14:42:14 14:36:01 5 0.90 0.00 0.12 8.01 0.02 90.96 14:42:14 14:36:01 6 0.72 0.00 0.07 0.00 0.03 99.18 14:42:14 14:36:01 7 0.90 0.00 0.08 0.00 0.02 99.00 14:42:14 14:37:01 all 1.56 0.00 0.25 0.25 0.04 97.90 14:42:14 14:37:01 0 0.22 0.00 0.08 0.02 0.02 99.67 14:42:14 14:37:01 1 1.90 0.00 0.15 0.00 0.05 97.90 14:42:14 14:37:01 2 1.50 0.00 0.17 0.00 0.02 98.32 14:42:14 14:37:01 3 1.34 0.00 0.59 0.00 0.03 98.03 14:42:14 14:37:01 4 1.12 0.00 0.32 0.02 0.07 98.48 14:42:14 14:37:01 5 1.80 0.00 0.23 1.87 0.03 96.06 14:42:14 14:37:01 6 1.93 0.00 0.18 0.12 0.02 97.75 14:42:14 14:37:01 7 2.70 0.00 0.20 0.02 0.07 97.02 14:42:14 14:38:01 all 0.57 0.00 0.15 0.02 0.04 99.22 14:42:14 14:38:01 0 0.38 0.00 0.12 0.00 0.02 99.48 14:42:14 14:38:01 1 0.63 0.00 0.12 0.00 0.08 99.17 14:42:14 14:38:01 2 0.75 0.00 0.07 0.00 0.02 99.17 14:42:14 14:38:01 3 0.91 0.00 0.63 0.02 0.05 98.40 14:42:14 14:38:01 4 0.45 0.00 0.07 0.03 0.03 99.42 14:42:14 14:38:01 5 0.45 0.00 0.12 0.05 0.05 99.33 14:42:14 14:38:01 6 0.55 0.00 0.03 0.00 0.02 99.40 14:42:14 14:38:01 7 0.48 0.00 0.08 0.00 0.02 99.42 14:42:14 14:39:01 all 1.37 0.00 0.20 0.01 0.03 98.40 14:42:14 14:39:01 0 1.30 0.00 0.15 0.00 0.02 98.53 14:42:14 14:39:01 1 1.39 0.00 0.15 0.00 0.03 98.43 14:42:14 14:39:01 2 1.57 0.00 0.18 0.00 0.00 98.25 14:42:14 14:39:01 3 1.60 0.00 0.42 0.02 0.07 97.90 14:42:14 14:39:01 4 1.37 0.00 0.15 0.03 0.03 98.42 14:42:14 14:39:01 5 1.71 0.00 0.18 0.03 0.05 98.02 14:42:14 14:39:01 6 1.10 0.00 0.23 0.00 0.05 98.62 14:42:14 14:39:01 7 0.87 0.00 0.10 0.03 0.00 99.00 14:42:14 14:40:01 all 0.80 0.00 0.13 0.01 0.03 99.02 14:42:14 14:40:01 0 0.40 0.00 0.05 0.00 0.05 99.50 14:42:14 14:40:01 1 1.19 0.00 0.61 0.00 0.05 98.15 14:42:14 14:40:01 2 0.53 0.00 0.10 0.00 0.02 99.35 14:42:14 14:40:01 3 0.32 0.00 0.05 0.00 0.03 99.60 14:42:14 14:40:01 4 0.42 0.00 0.05 0.00 0.02 99.52 14:42:14 14:40:01 5 2.51 0.00 0.12 0.02 0.05 97.30 14:42:14 14:40:01 6 0.32 0.00 0.02 0.03 0.00 99.63 14:42:14 14:40:01 7 0.73 0.00 0.08 0.05 0.03 99.10 14:42:14 14:42:14 14:40:01 CPU %user %nice %system %iowait %steal %idle 14:42:14 14:41:01 all 1.59 0.00 0.33 0.07 0.04 97.97 14:42:14 14:41:01 0 0.53 0.00 0.23 0.00 0.02 99.22 14:42:14 14:41:01 1 1.71 0.00 0.94 0.28 0.03 97.04 14:42:14 14:41:01 2 1.68 0.00 0.27 0.00 0.05 98.01 14:42:14 14:41:01 3 1.35 0.00 0.23 0.00 0.03 98.38 14:42:14 14:41:01 4 2.00 0.00 0.22 0.00 0.03 97.74 14:42:14 14:41:01 5 2.67 0.00 0.23 0.00 0.03 97.07 14:42:14 14:41:01 6 1.63 0.00 0.27 0.13 0.03 97.93 14:42:14 14:41:01 7 1.12 0.00 0.20 0.12 0.03 98.53 14:42:14 14:42:01 all 6.24 0.00 0.57 0.22 0.02 92.94 14:42:14 14:42:01 0 3.23 0.00 0.52 0.83 0.03 95.38 14:42:14 14:42:01 1 15.24 0.00 1.21 0.07 0.03 83.45 14:42:14 14:42:01 2 5.03 0.00 0.40 0.03 0.03 94.51 14:42:14 14:42:01 3 3.17 0.00 0.40 0.03 0.03 96.37 14:42:14 14:42:01 4 21.50 0.00 1.18 0.20 0.05 77.07 14:42:14 14:42:01 5 1.02 0.00 0.35 0.03 0.02 98.58 14:42:14 14:42:01 6 0.38 0.00 0.25 0.45 0.00 98.92 14:42:14 14:42:01 7 0.33 0.00 0.27 0.10 0.02 99.28 14:42:14 Average: all 4.97 0.00 0.79 1.13 0.04 93.07 14:42:14 Average: 0 3.03 0.00 0.72 2.27 0.04 93.93 14:42:14 Average: 1 4.89 0.00 0.84 0.13 0.04 94.10 14:42:14 Average: 2 5.70 0.00 0.77 3.07 0.03 90.43 14:42:14 Average: 3 6.07 0.00 0.91 0.33 0.04 92.65 14:42:14 Average: 4 6.53 0.00 0.83 0.45 0.04 92.15 14:42:14 Average: 5 4.34 0.00 0.77 2.35 0.03 92.52 14:42:14 Average: 6 4.27 0.00 0.68 0.24 0.03 94.78 14:42:14 Average: 7 4.95 0.00 0.81 0.20 0.03 94.01 14:42:14 14:42:14 14:42:14