22:04:56  Started by timer
22:04:56  Running as SYSTEM
22:04:56  [EnvInject] - Loading node environment variables.
22:04:56  Building remotely on prd-centos8-builder-2c-1g-7361 (centos8-builder-2c-1g) in workspace /w/workspace/ci-management-openstack-cron
22:04:56  [ssh-agent] Looking for ssh-agent implementation...
22:04:57  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
22:04:57  $ ssh-agent
22:04:57  SSH_AUTH_SOCK=/tmp/ssh-dpXWhMSIcatK/agent.15475
22:04:57  SSH_AGENT_PID=15476
22:04:57  [ssh-agent] Started.
22:04:57  Running ssh-add (command line suppressed)
22:04:57  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_4183538004658588783.key (/w/workspace/ci-management-openstack-cron@tmp/private_key_4183538004658588783.key)
22:04:57  [ssh-agent] Using credentials onap-jobbuiler (Gerrit user)
22:04:57  The recommended git tool is: NONE
22:04:59  using credential onap-jenkins-ssh
22:04:59  Wiping out workspace first.
22:04:59  Cloning the remote Git repository
22:04:59  Cloning repository git://cloud.onap.org/mirror/ci-management
22:04:59   > git init /w/workspace/ci-management-openstack-cron # timeout=10
22:04:59  Fetching upstream changes from git://cloud.onap.org/mirror/ci-management
22:04:59   > git --version # timeout=10
22:04:59   > git --version # 'git version 2.39.0'
22:04:59  using GIT_SSH to set credentials Gerrit user
22:04:59  [INFO] Currently running in a labeled security context
22:04:59  [INFO] Currently SELinux is 'enforcing' on the host
22:04:59   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh14653703110594132193.key
22:04:59  Verifying host key using manually-configured host key entries
22:04:59   > git fetch --tags --force --progress -- git://cloud.onap.org/mirror/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
22:05:00   > git config remote.origin.url git://cloud.onap.org/mirror/ci-management # timeout=10
22:05:00   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
22:05:01  Avoid second fetch
22:05:01   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
22:05:01  Checking out Revision 5202ccaf89a0896a7f3f43a2e2705eccb960d7f4 (refs/remotes/origin/master)
22:05:01   > git config core.sparsecheckout # timeout=10
22:05:01   > git checkout -f 5202ccaf89a0896a7f3f43a2e2705eccb960d7f4 # timeout=10
22:05:01  Commit message: "Use larger build node for multicloud-k8s-verify job"
22:05:01   > git rev-list --no-walk 5202ccaf89a0896a7f3f43a2e2705eccb960d7f4 # timeout=10
22:05:01   > git remote # timeout=10
22:05:01   > git submodule init # timeout=10
22:05:01   > git submodule sync # timeout=10
22:05:01   > git config --get remote.origin.url # timeout=10
22:05:01   > git submodule init # timeout=10
22:05:02   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
22:05:02   > git config --get submodule.global-jjb.url # timeout=10
22:05:02   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
22:05:02   > git config --get submodule.packer/common-packer.url # timeout=10
22:05:02   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
22:05:02   > git submodule update --init --recursive global-jjb # timeout=10
22:05:03   > git submodule update --init --recursive packer/common-packer # timeout=10
22:05:08  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:08  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:08  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:08  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:08  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:08  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:08  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
22:05:08  No emails were triggered.
22:05:08  provisioning config files...
22:05:08  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:05:08  copy managed file [npmrc] to file:/home/jenkins/.npmrc
22:05:08  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
22:05:08  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13432522577294374834.sh
22:05:08  ---> python-tools-install.sh
22:05:08  Setup pyenv:
22:05:08    system
22:05:08  * 3.8.13 (set by /opt/pyenv/version)
22:05:08  * 3.9.13 (set by /opt/pyenv/version)
22:05:08  * 3.10.6 (set by /opt/pyenv/version)
22:05:12  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-SftY
22:05:12  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
22:05:12  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:12  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:05:16  lf-activate-venv(): INFO: Base packages installed successfully
22:05:16  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:05:42  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:05:42  Generating Requirements File
22:06:00  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:06:00  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
22:06:01  Python 3.10.6
22:06:01  pip 25.3 from /tmp/venv-SftY/lib/python3.10/site-packages/pip (python 3.10)
22:06:01  appdirs==1.4.4
22:06:01  argcomplete==3.6.3
22:06:01  aspy.yaml==1.3.0
22:06:01  attrs==25.4.0
22:06:01  autopage==0.5.2
22:06:01  beautifulsoup4==4.14.2
22:06:01  boto3==1.40.62
22:06:01  botocore==1.40.62
22:06:01  bs4==0.0.2
22:06:01  cachetools==6.2.1
22:06:01  certifi==2025.10.5
22:06:01  cffi==2.0.0
22:06:01  cfgv==3.4.0
22:06:01  chardet==5.2.0
22:06:01  charset-normalizer==3.4.4
22:06:01  click==8.3.0
22:06:01  cliff==4.11.0
22:06:01  cmd2==2.7.0
22:06:01  cryptography==3.3.2
22:06:01  debtcollector==3.0.0
22:06:01  decorator==5.2.1
22:06:01  defusedxml==0.7.1
22:06:01  Deprecated==1.3.0
22:06:01  distlib==0.4.0
22:06:01  dnspython==2.8.0
22:06:01  docker==7.1.0
22:06:01  dogpile.cache==1.5.0
22:06:01  durationpy==0.10
22:06:01  email-validator==2.3.0
22:06:01  filelock==3.20.0
22:06:01  future==1.0.0
22:06:01  gitdb==4.0.12
22:06:01  GitPython==3.1.45
22:06:01  google-auth==2.42.0
22:06:01  httplib2==0.31.0
22:06:01  identify==2.6.15
22:06:01  idna==3.11
22:06:01  importlib-resources==1.5.0
22:06:01  iso8601==2.1.0
22:06:01  Jinja2==3.1.6
22:06:01  jmespath==1.0.1
22:06:01  jsonpatch==1.33
22:06:01  jsonpointer==3.0.0
22:06:01  jsonschema==4.25.1
22:06:01  jsonschema-specifications==2025.9.1
22:06:01  keystoneauth1==5.12.0
22:06:01  kubernetes==34.1.0
22:06:01  lftools==0.37.15
22:06:01  lxml==6.0.2
22:06:01  markdown-it-py==4.0.0
22:06:01  MarkupSafe==3.0.3
22:06:01  mdurl==0.1.2
22:06:01  msgpack==1.1.2
22:06:01  multi_key_dict==2.0.3
22:06:01  munch==4.0.0
22:06:01  netaddr==1.3.0
22:06:01  niet==1.4.2
22:06:01  nodeenv==1.9.1
22:06:01  oauth2client==4.1.3
22:06:01  oauthlib==3.3.1
22:06:01  openstacksdk==4.7.1
22:06:01  os-service-types==1.8.0
22:06:01  osc-lib==4.2.0
22:06:01  oslo.config==10.0.0
22:06:01  oslo.context==6.1.0
22:06:01  oslo.i18n==6.6.0
22:06:01  oslo.log==7.2.1
22:06:01  oslo.serialization==5.8.0
22:06:01  oslo.utils==9.1.0
22:06:01  packaging==25.0
22:06:01  pbr==7.0.1
22:06:01  platformdirs==4.5.0
22:06:01  prettytable==3.16.0
22:06:01  psutil==7.1.2
22:06:01  pyasn1==0.6.1
22:06:01  pyasn1_modules==0.4.2
22:06:01  pycparser==2.23
22:06:01  pygerrit2==2.0.15
22:06:01  PyGithub==2.8.1
22:06:01  Pygments==2.19.2
22:06:01  PyJWT==2.10.1
22:06:01  PyNaCl==1.6.0
22:06:01  pyparsing==2.4.7
22:06:01  pyperclip==1.11.0
22:06:01  pyrsistent==0.20.0
22:06:01  python-cinderclient==9.8.0
22:06:01  python-dateutil==2.9.0.post0
22:06:01  python-heatclient==4.3.0
22:06:01  python-jenkins==1.8.3
22:06:01  python-keystoneclient==5.7.0
22:06:01  python-magnumclient==4.9.0
22:06:01  python-openstackclient==8.2.0
22:06:01  python-swiftclient==4.8.0
22:06:01  PyYAML==6.0.3
22:06:01  referencing==0.37.0
22:06:01  requests==2.32.5
22:06:01  requests-oauthlib==2.0.0
22:06:01  requestsexceptions==1.4.0
22:06:01  rfc3986==2.0.0
22:06:01  rich==14.2.0
22:06:01  rich-argparse==1.7.1
22:06:01  rpds-py==0.28.0
22:06:01  rsa==4.9.1
22:06:01  ruamel.yaml==0.18.16
22:06:01  ruamel.yaml.clib==0.2.14
22:06:01  s3transfer==0.14.0
22:06:01  simplejson==3.20.2
22:06:01  six==1.17.0
22:06:01  smmap==5.0.2
22:06:01  soupsieve==2.8
22:06:01  stevedore==5.5.0
22:06:01  tabulate==0.9.0
22:06:01  toml==0.10.2
22:06:01  tomlkit==0.13.3
22:06:01  tqdm==4.67.1
22:06:01  typing_extensions==4.15.0
22:06:01  tzdata==2025.2
22:06:01  urllib3==1.26.20
22:06:01  virtualenv==20.35.4
22:06:01  wcwidth==0.2.14
22:06:01  websocket-client==1.9.0
22:06:01  wrapt==2.0.0
22:06:01  xdg==6.0.0
22:06:01  xmltodict==1.0.2
22:06:01  yq==3.4.3
22:06:01  [EnvInject] - Injecting environment variables from a build step.
22:06:01  [EnvInject] - Injecting as environment variables the properties content 
22:06:01  OS_CLOUD=vex
22:06:01  
22:06:01  [EnvInject] - Variables injected successfully.
22:06:01  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:01  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:01  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15194099297805136894.sh
22:06:01  ---> Orphaned k8s clusters
22:06:01  Setup pyenv:
22:06:01    system
22:06:01    3.8.13
22:06:01    3.9.13
22:06:01  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:01  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:06:01  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:01  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:06:03  lf-activate-venv(): INFO: Base packages installed successfully
22:06:03  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
22:06:10  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:06:10  lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
22:06:10  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:06:13  -----> Delete orphaned cluster
22:06:13  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:13  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:13  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7806162061860291850.sh
22:06:13  ---> Orphaned stacks
22:06:13  Setup pyenv:
22:06:13    system
22:06:13    3.8.13
22:06:13    3.9.13
22:06:13  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:06:13  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:13  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:06:15  lf-activate-venv(): INFO: Base packages installed successfully
22:06:15  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:06:29  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:06:29  + mapfile -t OS_COE_CLUSTERS_ID
22:06:29  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
22:06:29  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
22:06:29  ++ awk '{print $1}'
22:06:31  + echo '-----> Active clusters -> stacks'
22:06:31  -----> Active clusters -> stacks
22:06:31  + OS_COE_STACKS=()
22:06:31  + [[ 0 -gt 0 ]]
22:06:31  + mapfile -t OS_STACKS
22:06:31  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
22:06:31  ++ awk '{print $1}'
22:06:32  + echo '-----> Active stacks'
22:06:32  -----> Active stacks
22:06:32  + echo '-----> Delete orphaned stacks'
22:06:32  -----> Delete orphaned stacks
22:06:32  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:32  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:32  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins18339833853798923634.sh
22:06:32  ---> Orphaned servers
22:06:32  Setup pyenv:
22:06:32    system
22:06:32    3.8.13
22:06:32    3.9.13
22:06:32  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:06:33  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:33  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:06:34  lf-activate-venv(): INFO: Base packages installed successfully
22:06:34  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:06:46  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:06:49  -----> Active servers
22:06:49  prd-ubuntu2204-docker-8c-8g-7362
22:06:49  prd-centos8-builder-2c-1g-7361
22:06:49  prd-ubuntu2204-builder-4c-4g-7338
22:06:49  prd-queue-docker-4c-4g-6180
22:06:49  -----> Delete orphaned servers
22:06:50  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:50  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:50  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3035364165273080156.sh
22:06:50  ---> Orphaned ports
22:06:50  Setup pyenv:
22:06:50    system
22:06:50    3.8.13
22:06:50    3.9.13
22:06:50  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:50  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:06:50  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:50  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:06:52  lf-activate-venv(): INFO: Base packages installed successfully
22:06:52  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
22:07:03  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:07:05  No orphaned ports to process.
22:07:05  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:07:05  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:07:05  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7244562871580824355.sh
22:07:05  ---> Orphaned volumes
22:07:05  + source /home/jenkins/lf-env.sh
22:07:05  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:07:05  ++ mktemp -d /tmp/venv-XXXX
22:07:05  + lf_venv=/tmp/venv-jwJA
22:07:05  + local venv_file=/tmp/.os_lf_venv
22:07:05  + local python=python3
22:07:05  + local options
22:07:05  + local set_path=true
22:07:05  + local install_args=
22:07:05  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:07:05  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
22:07:05  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
22:07:05  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:07:05  + true
22:07:05  + case $1 in
22:07:05  + python=python3
22:07:05  + shift 2
22:07:05  + true
22:07:05  + case $1 in
22:07:05  + shift
22:07:05  + break
22:07:05  + case $python in
22:07:05  + local pkg_list=
22:07:05  + [[ -d /opt/pyenv ]]
22:07:05  + echo 'Setup pyenv:'
22:07:05  Setup pyenv:
22:07:05  + export PYENV_ROOT=/opt/pyenv
22:07:05  + PYENV_ROOT=/opt/pyenv
22:07:05  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:05  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:05  + pyenv versions
22:07:05    system
22:07:05    3.8.13
22:07:05    3.9.13
22:07:05  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:05  + command -v pyenv
22:07:05  ++ pyenv init - --no-rehash
22:07:05  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')"
22:07:05  export PATH="/opt/pyenv/shims:${PATH}"
22:07:05  export PYENV_SHELL=bash
22:07:05  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
22:07:05  pyenv() {
22:07:05    local command
22:07:05    command="${1:-}"
22:07:05    if [ "$#" -gt 0 ]; then
22:07:05      shift
22:07:05    fi
22:07:05  
22:07:05    case "$command" in
22:07:05    rehash|shell)
22:07:05      eval "$(pyenv "sh-$command" "$@")"
22:07:05      ;;
22:07:05    *)
22:07:05      command pyenv "$command" "$@"
22:07:05      ;;
22:07:05    esac
22:07:05  }'
22:07:05  +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"'
22:07:05  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:05  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:05  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:05  ++ export PYENV_SHELL=bash
22:07:05  ++ PYENV_SHELL=bash
22:07:05  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
22:07:05  +++ complete -F _pyenv pyenv
22:07:05  ++ lf-pyver python3
22:07:05  ++ local py_version_xy=python3
22:07:05  ++ local py_version_xyz=
22:07:05  ++ awk '{ print $1 }'
22:07:05  ++ pyenv versions
22:07:05  ++ local command
22:07:05  ++ command=versions
22:07:05  ++ '[' 1 -gt 0 ']'
22:07:05  ++ shift
22:07:05  ++ case "$command" in
22:07:05  ++ command pyenv versions
22:07:05  ++ pyenv versions
22:07:05  ++ sed 's/^[ *]* //'
22:07:05  ++ grep -E '^[0-9.]*[0-9]$'
22:07:05  ++ [[ ! -s /tmp/.pyenv_versions ]]
22:07:05  +++ grep '^3' /tmp/.pyenv_versions
22:07:05  +++ tail -n 1
22:07:05  +++ sort -V
22:07:05  ++ py_version_xyz=3.10.6
22:07:05  ++ [[ -z 3.10.6 ]]
22:07:05  ++ echo 3.10.6
22:07:05  ++ return 0
22:07:05  + pyenv local 3.10.6
22:07:05  + local command
22:07:05  + command=local
22:07:05  + '[' 2 -gt 0 ']'
22:07:05  + shift
22:07:05  + case "$command" in
22:07:05  + command pyenv local 3.10.6
22:07:05  + pyenv local 3.10.6
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='lftools[openstack] '
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='kubernetes '
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='niet '
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='python-heatclient '
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='python-openstackclient '
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='python-magnumclient '
22:07:05  + for arg in "$@"
22:07:05  + case $arg in
22:07:05  + pkg_list+='yq '
22:07:05  + [[ -f /tmp/.os_lf_venv ]]
22:07:05  ++ cat /tmp/.os_lf_venv
22:07:05  + lf_venv=/tmp/venv-SftY
22:07:05  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from' file:/tmp/.os_lf_venv
22:07:05  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:07:05  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
22:07:05  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:05  + local 'pip_opts=--upgrade --quiet'
22:07:05  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
22:07:05  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
22:07:05  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
22:07:05  + [[ -n '' ]]
22:07:05  + [[ -n '' ]]
22:07:05  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
22:07:05  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:07:05  + /tmp/venv-SftY/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
22:07:07  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
22:07:07  lf-activate-venv(): INFO: Base packages installed successfully
22:07:07  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
22:07:07  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
22:07:07  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:07:07  + /tmp/venv-SftY/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:07:30  + type python3
22:07:30  + true
22:07:30  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH'
22:07:30  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:07:30  + PATH=/tmp/venv-SftY/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:30  + return 0
22:07:30  + mapfile -t os_volumes
22:07:30  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
22:07:33  + '[' 0 -eq 0 ']'
22:07:33  + echo 'No orphaned volumes found.'
22:07:33  No orphaned volumes found.
22:07:33  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:07:33  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:07:33  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12146205248426497293.sh
22:07:33  ---> Protect in-use images
22:07:33  Setup pyenv:
22:07:33    system
22:07:33    3.8.13
22:07:33    3.9.13
22:07:33  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:33  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:07:33  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:33  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:07:35  lf-activate-venv(): INFO: Base packages installed successfully
22:07:35  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
22:07:46  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:07:46  INFO: There are images to protect defined in jenkins-config.
22:07:46  INFO: Protecting the following images:
22:07:46  CentOS Stream 8 - redis -  - 310180101-1010
22:07:46  Ubuntu 20.04 - memcached - x86_64 - 160580505-5011
22:07:46  ZZCI - CentOS 7 - builder - x86_64 - 20211001-132245.747
22:07:46  ZZCI - CentOS 7 - docker - x86_64 - 20220919-201912.261
22:07:46  ZZCI - CentOS Stream 8 - builder - x86_64 - 20230131-200810.126
22:07:46  ZZCI - CentOS Stream 8 - docker - x86_64 - 20230215-011800.297
22:07:46  ZZCI - Ubuntu 18.04 - builder - x86_64 - 20221013-041722.509
22:07:46  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20220919-185927.020
22:07:46  ZZCI - Ubuntu 20.04 - builder - x86_64 - 20230412-164405.694
22:07:46  ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-103335.070
22:07:46  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20220919-201946.022
22:07:46  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20230414-200946.220
22:07:46  ZZCI - Ubuntu 20.04 - helm - x86_64 - 20230405-210810.069
22:07:46  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250424-093435.248
22:07:46  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250623-071957.883
22:07:47  Protected setting for CentOS Stream 8 - redis -  - 310180101-1010: True
22:07:49  Protected setting for Ubuntu 20.04 - memcached - x86_64 - 160580505-5011: True
22:07:50  No Image found for ZZCI - CentOS 7 - builder - x86_64 - 20211001-132245.747
22:07:50  Build step 'Conditional step (single)' marked build as failure
22:07:50  $ ssh-agent -k
22:07:50  unset SSH_AUTH_SOCK;
22:07:50  unset SSH_AGENT_PID;
22:07:50  echo Agent pid 15476 killed;
22:07:50  [ssh-agent] Stopped.
22:07:51  [PostBuildScript] - [INFO] Executing post build scripts.
22:07:51  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2973475222120676995.sh
22:07:51  ---> sysstat.sh
22:07:51  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3353800120433197140.sh
22:07:51  ---> package-listing.sh
22:07:51  ++ facter osfamily
22:07:51  ++ tr '[:upper:]' '[:lower:]'
22:07:51  + OS_FAMILY=redhat
22:07:51  + workspace=/w/workspace/ci-management-openstack-cron
22:07:51  + START_PACKAGES=/tmp/packages_start.txt
22:07:51  + END_PACKAGES=/tmp/packages_end.txt
22:07:51  + DIFF_PACKAGES=/tmp/packages_diff.txt
22:07:51  + PACKAGES=/tmp/packages_start.txt
22:07:51  + '[' /w/workspace/ci-management-openstack-cron ']'
22:07:51  + PACKAGES=/tmp/packages_end.txt
22:07:51  + case "${OS_FAMILY}" in
22:07:51  + rpm -qa
22:07:51  + sort
22:07:52  + '[' -f /tmp/packages_start.txt ']'
22:07:52  + '[' -f /tmp/packages_end.txt ']'
22:07:52  + diff /tmp/packages_start.txt /tmp/packages_end.txt
22:07:52  + '[' /w/workspace/ci-management-openstack-cron ']'
22:07:52  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
22:07:52  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
22:07:52  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15035639716650586577.sh
22:07:52  ---> capture-instance-metadata.sh
22:07:52  Setup pyenv:
22:07:52    system
22:07:52    3.8.13
22:07:52    3.9.13
22:07:52  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:52  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:07:52  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:52  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:07:54  lf-activate-venv(): INFO: Base packages installed successfully
22:07:54  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:08:02  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:08:02  INFO: Running in OpenStack, capturing instance metadata
22:08:02  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2280742524367165397.sh
22:08:02  provisioning config files...
22:08:02  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config6740515810162609216tmp
22:08:02  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
22:08:02  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
22:08:02  [EnvInject] - Injecting environment variables from a build step.
22:08:02  [EnvInject] - Injecting as environment variables the properties content 
22:08:02  SERVER_ID=logs
22:08:02  
22:08:02  [EnvInject] - Variables injected successfully.
22:08:02  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9446825883488125792.sh
22:08:02  ---> create-netrc.sh
22:08:02  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7267995883609592093.sh
22:08:02  ---> python-tools-install.sh
22:08:02  Setup pyenv:
22:08:02    system
22:08:02    3.8.13
22:08:02    3.9.13
22:08:02  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:08:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:02  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:08:04  lf-activate-venv(): INFO: Base packages installed successfully
22:08:04  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:08:12  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:08:12  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4464380706690964444.sh
22:08:12  ---> sudo-logs.sh
22:08:12  Archiving 'sudo' log..
22:08:13  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7161812413012847925.sh
22:08:13  ---> job-cost.sh
22:08:13  Setup pyenv:
22:08:13    system
22:08:13    3.8.13
22:08:13    3.9.13
22:08:13  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:13  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:08:13  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:13  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:08:15  lf-activate-venv(): INFO: Base packages installed successfully
22:08:15  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
22:08:21  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:08:21  INFO: No Stack...
22:08:21  INFO: Retrieving Pricing Info for: v3-standard-2
22:08:21  INFO: Archiving Costs
22:08:21  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins5824016901038997859.sh
22:08:21  ---> logs-deploy.sh
22:08:21  Setup pyenv:
22:08:21    system
22:08:21    3.8.13
22:08:21    3.9.13
22:08:21  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:22  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-SftY from file:/tmp/.os_lf_venv
22:08:22  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:22  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:08:23  lf-activate-venv(): INFO: Base packages installed successfully
22:08:23  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:08:32  lf-activate-venv(): INFO: Adding /tmp/venv-SftY/bin to PATH
22:08:32  INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/ci-management-openstack-cron/57703
22:08:32  INFO: archiving workspace using pattern(s): 
22:08:33  Archives upload complete.
22:08:33  INFO: archiving logs to Nexus
22:08:34  ---> uname -a:
22:08:34  Linux prd-centos8-builder-2c-1g-7361.novalocal 4.18.0-448.el8.x86_64 #1 SMP Wed Jan 18 15:02:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
22:08:34  
22:08:34  
22:08:34  ---> lscpu:
22:08:34  Architecture:        x86_64
22:08:34  CPU op-mode(s):      32-bit, 64-bit
22:08:34  Byte Order:          Little Endian
22:08:34  CPU(s):              2
22:08:34  On-line CPU(s) list: 0,1
22:08:34  Thread(s) per core:  1
22:08:34  Core(s) per socket:  1
22:08:34  Socket(s):           2
22:08:34  NUMA node(s):        1
22:08:34  Vendor ID:           AuthenticAMD
22:08:34  CPU family:          23
22:08:34  Model:               49
22:08:34  Model name:          AMD EPYC-Rome Processor
22:08:34  Stepping:            0
22:08:34  CPU MHz:             2800.000
22:08:34  BogoMIPS:            5600.00
22:08:34  Virtualization:      AMD-V
22:08:34  Hypervisor vendor:   KVM
22:08:34  Virtualization type: full
22:08:34  L1d cache:           32K
22:08:34  L1i cache:           32K
22:08:34  L2 cache:            512K
22:08:34  L3 cache:            16384K
22:08:34  NUMA node0 CPU(s):   0,1
22:08:34  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
22:08:34  
22:08:34  
22:08:34  ---> nproc:
22:08:34  2
22:08:34  
22:08:34  
22:08:34  ---> df -h:
22:08:34  Filesystem      Size  Used Avail Use% Mounted on
22:08:34  devtmpfs        3.8G     0  3.8G   0% /dev
22:08:34  tmpfs           3.8G     0  3.8G   0% /dev/shm
22:08:34  tmpfs           3.8G   17M  3.8G   1% /run
22:08:34  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
22:08:34  /dev/vda1        40G  8.4G   32G  21% /
22:08:34  tmpfs           770M     0  770M   0% /run/user/1001
22:08:34  
22:08:34  
22:08:34  ---> free -m:
22:08:34                total        used        free      shared  buff/cache   available
22:08:34  Mem:           7699         555        5048          19        2095        6837
22:08:34  Swap:          1023           0        1023
22:08:34  
22:08:34  
22:08:34  ---> ip addr:
22:08:34  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
22:08:34      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
22:08:34      inet 127.0.0.1/8 scope host lo
22:08:34         valid_lft forever preferred_lft forever
22:08:34      inet6 ::1/128 scope host 
22:08:34         valid_lft forever preferred_lft forever
22:08:34  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
22:08:34      link/ether fa:16:3e:c3:21:52 brd ff:ff:ff:ff:ff:ff
22:08:34      altname enp0s3
22:08:34      altname ens3
22:08:34      inet 10.30.107.149/23 brd 10.30.107.255 scope global dynamic noprefixroute eth0
22:08:34         valid_lft 86156sec preferred_lft 86156sec
22:08:34      inet6 fe80::f816:3eff:fec3:2152/64 scope link 
22:08:34         valid_lft forever preferred_lft forever
22:08:34  
22:08:34  
22:08:34  ---> sar -b -r -n DEV:
22:08:34  Linux 4.18.0-448.el8.x86_64 (centos-stream-8-builder-63d9752a-2c92-2a07-2618-33e2bb46e6c7.nov) 	10/29/2025 	_x86_64_	(2 CPU)
22:08:34  
22:08:34  22:04:27     LINUX RESTART	(2 CPU)
22:08:34  
22:08:34  10:05:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
22:08:34  10:06:01 PM    320.60    121.38    199.22   1975.54   8506.97
22:08:34  10:07:02 PM     97.17      0.68     96.48     93.17   9121.21
22:08:34  10:08:01 PM     24.76      0.19     24.57     13.69    693.56
22:08:34  Average:       148.19     40.97    107.22    697.90   6137.65
22:08:34  
22:08:34  10:05:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
22:08:34  10:06:01 PM   5266968   7081548   2617476     33.20      2688   1981520    648008      7.25    196308   2061568    222732
22:08:34  10:07:02 PM   5104520   6930180   2779924     35.26      2688   1991516    756624      8.47    226840   2181060      7652
22:08:34  10:08:01 PM   5108100   6941284   2776344     35.21      2688   1998824    753592      8.44    397032   2006680     14552
22:08:34  Average:      5159863   6984337   2724581     34.56      2688   1990620    719408      8.05    273393   2083103     81645
22:08:34  
22:08:34  10:05:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
22:08:34  10:06:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:34  10:06:01 PM      eth0     91.62     63.31   1292.95     18.03      0.00      0.00      0.00      0.00
22:08:34  10:07:02 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:34  10:07:02 PM      eth0     31.57     24.29     55.24     11.68      0.00      0.00      0.00      0.00
22:08:34  10:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:34  10:08:01 PM      eth0     22.78     18.52     17.10      8.22      0.00      0.00      0.00      0.00
22:08:34  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:34  Average:         eth0     48.80     35.47    457.52     12.67      0.00      0.00      0.00      0.00
22:08:34  
22:08:34  
22:08:34  ---> sar -P ALL:
22:08:34  Linux 4.18.0-448.el8.x86_64 (centos-stream-8-builder-63d9752a-2c92-2a07-2618-33e2bb46e6c7.nov) 	10/29/2025 	_x86_64_	(2 CPU)
22:08:34  
22:08:34  22:04:27     LINUX RESTART	(2 CPU)
22:08:34  
22:08:34  10:05:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
22:08:34  10:06:01 PM     all     37.71      2.43     18.53      9.13      0.14     32.06
22:08:34  10:06:01 PM       0     42.02      2.24     16.57      9.05      0.15     29.97
22:08:34  10:06:01 PM       1     33.34      2.62     20.51      9.22      0.14     34.18
22:08:34  10:07:02 PM     all     39.31      0.00      3.08      1.40      0.11     56.10
22:08:34  10:07:02 PM       0     46.12      0.00      2.93      1.20      0.10     49.66
22:08:34  10:07:02 PM       1     32.50      0.00      3.23      1.60      0.12     62.55
22:08:34  10:08:01 PM     all     33.14      0.00      2.42      0.39      0.09     63.96
22:08:34  10:08:01 PM       0     48.58      0.00      2.95      0.56      0.10     47.80
22:08:34  10:08:01 PM       1     17.75      0.00      1.89      0.22      0.08     80.06
22:08:34  Average:        all     36.74      0.80      7.98      3.63      0.11     50.73
22:08:34  Average:          0     45.57      0.74      7.48      3.60      0.12     42.49
22:08:34  Average:          1     27.88      0.86      8.49      3.66      0.11     59.00
22:08:34  
22:08:34  
22:08:34