22:03:55  Started by timer
22:03:55  Running as SYSTEM
22:03:55  [EnvInject] - Loading node environment variables.
22:03:55  Building remotely on prd-centos8-builder-2c-1g-1893 (centos8-builder-2c-1g) in workspace /w/workspace/ci-management-openstack-cron
22:03:55  [ssh-agent] Looking for ssh-agent implementation...
22:03:55  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
22:03:55  $ ssh-agent
22:03:55  SSH_AUTH_SOCK=/tmp/ssh-rs3ov1FNfn4I/agent.15200
22:03:55  SSH_AGENT_PID=15202
22:03:55  [ssh-agent] Started.
22:03:55  Running ssh-add (command line suppressed)
22:03:55  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_2923737893738658666.key (/w/workspace/ci-management-openstack-cron@tmp/private_key_2923737893738658666.key)
22:03:56  [ssh-agent] Using credentials onap-jobbuiler (Gerrit user)
22:03:56  The recommended git tool is: NONE
22:03:57  using credential onap-jenkins-ssh
22:03:58  Wiping out workspace first.
22:03:58  Cloning the remote Git repository
22:03:58  Cloning repository git://cloud.onap.org/mirror/ci-management
22:03:58   > git init /w/workspace/ci-management-openstack-cron # timeout=10
22:03:58  Fetching upstream changes from git://cloud.onap.org/mirror/ci-management
22:03:58   > git --version # timeout=10
22:03:58   > git --version # 'git version 2.39.0'
22:03:58  using GIT_SSH to set credentials Gerrit user
22:03:58  [INFO] Currently running in a labeled security context
22:03:58  [INFO] Currently SELinux is 'enforcing' on the host
22:03:58   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh18303321291633755346.key
22:03:58  Verifying host key using manually-configured host key entries
22:03:58   > git fetch --tags --force --progress -- git://cloud.onap.org/mirror/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
22:03:59   > git config remote.origin.url git://cloud.onap.org/mirror/ci-management # timeout=10
22:03:59   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:00  Avoid second fetch
22:04:00   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
22:04:00  Checking out Revision 58929f9e6d4ad191a4e8dc5647b0bd11dd64d51e (refs/remotes/origin/master)
22:04:00   > git config core.sparsecheckout # timeout=10
22:04:00   > git checkout -f 58929f9e6d4ad191a4e8dc5647b0bd11dd64d51e # timeout=10
22:04:00  Commit message: "CI: Add trigger to support retesting"
22:04:00   > git rev-list --no-walk 58929f9e6d4ad191a4e8dc5647b0bd11dd64d51e # timeout=10
22:04:00   > git remote # timeout=10
22:04:00   > git submodule init # timeout=10
22:04:00   > git submodule sync # timeout=10
22:04:00   > git config --get remote.origin.url # timeout=10
22:04:00   > git submodule init # timeout=10
22:04:00   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
22:04:00   > git config --get submodule.global-jjb.url # timeout=10
22:04:00   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
22:04:00   > git config --get submodule.packer/common-packer.url # timeout=10
22:04:00   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
22:04:01   > git submodule update --init --recursive global-jjb # timeout=10
22:04:01   > git submodule update --init --recursive packer/common-packer # timeout=10
22:04:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:04:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:04:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:04:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:04:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:04:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:04:05  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
22:04:05  No emails were triggered.
22:04:05  provisioning config files...
22:04:05  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:04:05  copy managed file [npmrc] to file:/home/jenkins/.npmrc
22:04:05  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
22:04:05  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4557781130146686608.sh
22:04:05  ---> python-tools-install.sh
22:04:05  Setup pyenv:
22:04:05    system
22:04:05  * 3.8.13 (set by /opt/pyenv/version)
22:04:05  * 3.9.13 (set by /opt/pyenv/version)
22:04:05  * 3.10.6 (set by /opt/pyenv/version)
22:04:10  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-dJlT
22:04:10  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
22:04:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:04:10  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:04:14  lf-activate-venv(): INFO: Base packages installed successfully
22:04:14  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:04:38  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:04:38  Generating Requirements File
22:05:00  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:05:00  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
22:05:01  Python 3.10.6
22:05:01  pip 25.2 from /tmp/venv-dJlT/lib/python3.10/site-packages/pip (python 3.10)
22:05:01  appdirs==1.4.4
22:05:01  argcomplete==3.6.2
22:05:01  aspy.yaml==1.3.0
22:05:01  attrs==25.4.0
22:05:01  autopage==0.5.2
22:05:01  beautifulsoup4==4.14.2
22:05:01  boto3==1.40.50
22:05:01  botocore==1.40.50
22:05:01  bs4==0.0.2
22:05:01  cachetools==6.2.0
22:05:01  certifi==2025.10.5
22:05:01  cffi==2.0.0
22:05:01  cfgv==3.4.0
22:05:01  chardet==5.2.0
22:05:01  charset-normalizer==3.4.3
22:05:01  click==8.3.0
22:05:01  cliff==4.11.0
22:05:01  cmd2==2.7.0
22:05:01  cryptography==3.3.2
22:05:01  debtcollector==3.0.0
22:05:01  decorator==5.2.1
22:05:01  defusedxml==0.7.1
22:05:01  Deprecated==1.2.18
22:05:01  distlib==0.4.0
22:05:01  dnspython==2.8.0
22:05:01  docker==7.1.0
22:05:01  dogpile.cache==1.4.1
22:05:01  durationpy==0.10
22:05:01  email-validator==2.3.0
22:05:01  filelock==3.20.0
22:05:01  future==1.0.0
22:05:01  gitdb==4.0.12
22:05:01  GitPython==3.1.45
22:05:01  google-auth==2.41.1
22:05:01  httplib2==0.31.0
22:05:01  identify==2.6.15
22:05:01  idna==3.10
22:05:01  importlib-resources==1.5.0
22:05:01  iso8601==2.1.0
22:05:01  Jinja2==3.1.6
22:05:01  jmespath==1.0.1
22:05:01  jsonpatch==1.33
22:05:01  jsonpointer==3.0.0
22:05:01  jsonschema==4.25.1
22:05:01  jsonschema-specifications==2025.9.1
22:05:01  keystoneauth1==5.12.0
22:05:01  kubernetes==34.1.0
22:05:01  lftools==0.37.15
22:05:01  lxml==6.0.2
22:05:01  markdown-it-py==4.0.0
22:05:01  MarkupSafe==3.0.3
22:05:01  mdurl==0.1.2
22:05:01  msgpack==1.1.2
22:05:01  multi_key_dict==2.0.3
22:05:01  munch==4.0.0
22:05:01  netaddr==1.3.0
22:05:01  niet==1.4.2
22:05:01  nodeenv==1.9.1
22:05:01  oauth2client==4.1.3
22:05:01  oauthlib==3.3.1
22:05:01  openstacksdk==4.7.1
22:05:01  os-service-types==1.8.0
22:05:01  osc-lib==4.2.0
22:05:01  oslo.config==10.0.0
22:05:01  oslo.context==6.1.0
22:05:01  oslo.i18n==6.6.0
22:05:01  oslo.log==7.2.1
22:05:01  oslo.serialization==5.8.0
22:05:01  oslo.utils==9.1.0
22:05:01  packaging==25.0
22:05:01  pbr==7.0.1
22:05:01  platformdirs==4.5.0
22:05:01  prettytable==3.16.0
22:05:01  psutil==7.1.0
22:05:01  pyasn1==0.6.1
22:05:01  pyasn1_modules==0.4.2
22:05:01  pycparser==2.23
22:05:01  pygerrit2==2.0.15
22:05:01  PyGithub==2.8.1
22:05:01  Pygments==2.19.2
22:05:01  PyJWT==2.10.1
22:05:01  PyNaCl==1.6.0
22:05:01  pyparsing==2.4.7
22:05:01  pyperclip==1.11.0
22:05:01  pyrsistent==0.20.0
22:05:01  python-cinderclient==9.8.0
22:05:01  python-dateutil==2.9.0.post0
22:05:01  python-heatclient==4.3.0
22:05:01  python-jenkins==1.8.3
22:05:01  python-keystoneclient==5.7.0
22:05:01  python-magnumclient==4.9.0
22:05:01  python-openstackclient==8.2.0
22:05:01  python-swiftclient==4.8.0
22:05:01  PyYAML==6.0.3
22:05:01  referencing==0.36.2
22:05:01  requests==2.32.5
22:05:01  requests-oauthlib==2.0.0
22:05:01  requestsexceptions==1.4.0
22:05:01  rfc3986==2.0.0
22:05:01  rich==14.2.0
22:05:01  rich-argparse==1.7.1
22:05:01  rpds-py==0.27.1
22:05:01  rsa==4.9.1
22:05:01  ruamel.yaml==0.18.15
22:05:01  ruamel.yaml.clib==0.2.14
22:05:01  s3transfer==0.14.0
22:05:01  simplejson==3.20.2
22:05:01  six==1.17.0
22:05:01  smmap==5.0.2
22:05:01  soupsieve==2.8
22:05:01  stevedore==5.5.0
22:05:01  tabulate==0.9.0
22:05:01  toml==0.10.2
22:05:01  tomlkit==0.13.3
22:05:01  tqdm==4.67.1
22:05:01  typing_extensions==4.15.0
22:05:01  tzdata==2025.2
22:05:01  urllib3==1.26.20
22:05:01  virtualenv==20.35.3
22:05:01  wcwidth==0.2.14
22:05:01  websocket-client==1.9.0
22:05:01  wrapt==1.17.3
22:05:01  xdg==6.0.0
22:05:01  xmltodict==1.0.2
22:05:01  yq==3.4.3
22:05:01  [EnvInject] - Injecting environment variables from a build step.
22:05:01  [EnvInject] - Injecting as environment variables the properties content 
22:05:01  OS_CLOUD=vex
22:05:01  
22:05:01  [EnvInject] - Variables injected successfully.
22:05:01  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:05:01  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:05:01  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins14640383165930166346.sh
22:05:01  ---> Orphaned k8s clusters
22:05:01  Setup pyenv:
22:05:02    system
22:05:02    3.8.13
22:05:02    3.9.13
22:05:02  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:05:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:05:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:02  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:05:04  lf-activate-venv(): INFO: Base packages installed successfully
22:05:04  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
22:05:13  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:05:13  lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
22:05:13  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:05:16  -----> Delete orphaned cluster
22:05:16  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:05:16  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:05:16  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12733776899279310406.sh
22:05:16  ---> Orphaned stacks
22:05:16  Setup pyenv:
22:05:16    system
22:05:16    3.8.13
22:05:16    3.9.13
22:05:16  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:05:16  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:05:16  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:16  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:05:18  lf-activate-venv(): INFO: Base packages installed successfully
22:05:18  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:05:36  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:05:36  + mapfile -t OS_COE_CLUSTERS_ID
22:05:36  ++ awk '{print $1}'
22:05:36  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
22:05:36  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
22:05:39  + echo '-----> Active clusters -> stacks'
22:05:39  -----> Active clusters -> stacks
22:05:39  + OS_COE_STACKS=()
22:05:39  + [[ 0 -gt 0 ]]
22:05:39  + mapfile -t OS_STACKS
22:05:39  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
22:05:39  ++ awk '{print $1}'
22:05:40  + echo '-----> Active stacks'
22:05:40  -----> Active stacks
22:05:40  + echo '-----> Delete orphaned stacks'
22:05:40  -----> Delete orphaned stacks
22:05:40  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:05:40  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:05:40  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17570573076503840539.sh
22:05:40  ---> Orphaned servers
22:05:40  Setup pyenv:
22:05:40    system
22:05:40    3.8.13
22:05:40    3.9.13
22:05:40  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:05:41  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:05:41  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:41  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:05:43  lf-activate-venv(): INFO: Base packages installed successfully
22:05:43  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:05:56  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:06:00  -----> Active servers
22:06:00  prd-centos8-builder-2c-1g-1893
22:06:00  prd-queue-docker-4c-4g-1915
22:06:00  prd-ubuntu2004-helm-2c-1g-1400
22:06:00  -----> Delete orphaned servers
22:06:00  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:00  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:00  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins588877443284640609.sh
22:06:00  ---> Orphaned ports
22:06:00  Setup pyenv:
22:06:00    system
22:06:00    3.8.13
22:06:00    3.9.13
22:06:00  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:01  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:06:01  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:01  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:06:02  lf-activate-venv(): INFO: Base packages installed successfully
22:06:02  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
22:06:18  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:06:19  Ports to process: 1; age limit: 1760132178
22:06:19  Using 6 parallel processes...
22:06:20  sh: /dev/tty: No such device or address
22:06:20  
22:06:20  Computers / CPU cores / Max jobs to run
22:06:20  1:local / 2 / 2
22:06:20  
22:06:20  Computer:jobs running/jobs completed/%of started jobs/Average seconds to complete
22:06:22  
local:1/0/100%/0.0s sh: /dev/tty: No such device or address
22:06:22  
local:1/0/100%/0.0s 
local:0/1/100%/3.0s 
local:0/1/100%/3.0s 
22:06:22  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:22  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:22  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins13612346414420620463.sh
22:06:22  ---> Orphaned volumes
22:06:22  + source /home/jenkins/lf-env.sh
22:06:22  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:06:22  ++ mktemp -d /tmp/venv-XXXX
22:06:22  + lf_venv=/tmp/venv-yyjm
22:06:22  + local venv_file=/tmp/.os_lf_venv
22:06:22  + local python=python3
22:06:22  + local options
22:06:22  + local set_path=true
22:06:22  + local install_args=
22:06:22  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:06:22  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
22:06:22  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
22:06:22  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:06:22  + true
22:06:22  + case $1 in
22:06:22  + python=python3
22:06:22  + shift 2
22:06:22  + true
22:06:22  + case $1 in
22:06:22  + shift
22:06:22  + break
22:06:22  + case $python in
22:06:22  + local pkg_list=
22:06:22  + [[ -d /opt/pyenv ]]
22:06:22  + echo 'Setup pyenv:'
22:06:22  Setup pyenv:
22:06:22  + export PYENV_ROOT=/opt/pyenv
22:06:22  + PYENV_ROOT=/opt/pyenv
22:06:22  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:06:22  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:06:22  + pyenv versions
22:06:22    system
22:06:22    3.8.13
22:06:22    3.9.13
22:06:22  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:22  + command -v pyenv
22:06:22  ++ pyenv init - --no-rehash
22:06:22  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')"
22:06:22  export PATH="/opt/pyenv/shims:${PATH}"
22:06:22  export PYENV_SHELL=bash
22:06:22  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
22:06:22  pyenv() {
22:06:22    local command
22:06:22    command="${1:-}"
22:06:22    if [ "$#" -gt 0 ]; then
22:06:22      shift
22:06:22    fi
22:06:22  
22:06:22    case "$command" in
22:06:22    rehash|shell)
22:06:22      eval "$(pyenv "sh-$command" "$@")"
22:06:22      ;;
22:06:22    *)
22:06:22      command pyenv "$command" "$@"
22:06:22      ;;
22:06:22    esac
22:06:22  }'
22:06:22  +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"'
22:06:22  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:06:22  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:06:22  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:06:22  ++ export PYENV_SHELL=bash
22:06:22  ++ PYENV_SHELL=bash
22:06:22  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
22:06:22  +++ complete -F _pyenv pyenv
22:06:22  ++ lf-pyver python3
22:06:22  ++ local py_version_xy=python3
22:06:22  ++ local py_version_xyz=
22:06:22  ++ sed 's/^[ *]* //'
22:06:22  ++ awk '{ print $1 }'
22:06:22  ++ grep -E '^[0-9.]*[0-9]$'
22:06:22  ++ pyenv versions
22:06:22  ++ local command
22:06:22  ++ command=versions
22:06:22  ++ '[' 1 -gt 0 ']'
22:06:22  ++ shift
22:06:22  ++ case "$command" in
22:06:22  ++ command pyenv versions
22:06:22  ++ pyenv versions
22:06:22  ++ [[ ! -s /tmp/.pyenv_versions ]]
22:06:22  +++ grep '^3' /tmp/.pyenv_versions
22:06:22  +++ tail -n 1
22:06:22  +++ sort -V
22:06:22  ++ py_version_xyz=3.10.6
22:06:22  ++ [[ -z 3.10.6 ]]
22:06:22  ++ echo 3.10.6
22:06:22  ++ return 0
22:06:22  + pyenv local 3.10.6
22:06:22  + local command
22:06:22  + command=local
22:06:22  + '[' 2 -gt 0 ']'
22:06:22  + shift
22:06:22  + case "$command" in
22:06:22  + command pyenv local 3.10.6
22:06:22  + pyenv local 3.10.6
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='lftools[openstack] '
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='kubernetes '
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='niet '
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='python-heatclient '
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='python-openstackclient '
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='python-magnumclient '
22:06:22  + for arg in "$@"
22:06:22  + case $arg in
22:06:22  + pkg_list+='yq '
22:06:22  + [[ -f /tmp/.os_lf_venv ]]
22:06:22  ++ cat /tmp/.os_lf_venv
22:06:22  + lf_venv=/tmp/venv-dJlT
22:06:22  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from' file:/tmp/.os_lf_venv
22:06:22  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:06:22  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
22:06:22  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:22  + local 'pip_opts=--upgrade --quiet'
22:06:22  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
22:06:22  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
22:06:22  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
22:06:22  + [[ -n '' ]]
22:06:22  + [[ -n '' ]]
22:06:22  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
22:06:22  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:06:22  + /tmp/venv-dJlT/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
22:06:42  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
22:06:42  lf-activate-venv(): INFO: Base packages installed successfully
22:06:42  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
22:06:42  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
22:06:42  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:06:42  + /tmp/venv-dJlT/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
22:07:07  + type python3
22:07:07  + true
22:07:07  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH'
22:07:07  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:07:07  + PATH=/tmp/venv-dJlT/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
22:07:07  + return 0
22:07:07  + mapfile -t os_volumes
22:07:07  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
22:07:09  + '[' 0 -eq 0 ']'
22:07:09  + echo 'No orphaned volumes found.'
22:07:09  No orphaned volumes found.
22:07:09  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:07:09  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:07:09  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins5867655486055860148.sh
22:07:09  ---> Protect in-use images
22:07:09  Setup pyenv:
22:07:09    system
22:07:09    3.8.13
22:07:09    3.9.13
22:07:09  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:10  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:07:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:10  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:07:13  lf-activate-venv(): INFO: Base packages installed successfully
22:07:13  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
22:07:41  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:07:41  INFO: There are images to protect defined in jenkins-config.
22:07:41  INFO: Protecting the following images:
22:07:41  CentOS Stream 8 - redis -  - 310180101-1010
22:07:41  Ubuntu 20.04 - memcached - x86_64 - 160580505-5011
22:07:41  ZZCI - CentOS 7 - builder - x86_64 - 20211001-132245.747
22:07:41  ZZCI - CentOS 7 - docker - x86_64 - 20220919-201912.261
22:07:41  ZZCI - CentOS Stream 8 - builder - x86_64 - 20230131-200810.126
22:07:41  ZZCI - CentOS Stream 8 - docker - x86_64 - 20230215-011800.297
22:07:41  ZZCI - Ubuntu 18.04 - builder - x86_64 - 20221013-041722.509
22:07:41  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20220919-185927.020
22:07:41  ZZCI - Ubuntu 20.04 - builder - x86_64 - 20230412-164405.694
22:07:41  ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-103335.070
22:07:41  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20220919-201946.022
22:07:41  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20230414-200946.220
22:07:41  ZZCI - Ubuntu 20.04 - helm - x86_64 - 20230405-210810.069
22:07:41  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250424-093435.248
22:07:41  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250623-071957.883
22:07:43  Protected setting for CentOS Stream 8 - redis -  - 310180101-1010: True
22:07:44  Protected setting for Ubuntu 20.04 - memcached - x86_64 - 160580505-5011: True
22:07:46  No Image found for ZZCI - CentOS 7 - builder - x86_64 - 20211001-132245.747
22:07:46  Build step 'Conditional step (single)' marked build as failure
22:07:46  $ ssh-agent -k
22:07:46  unset SSH_AUTH_SOCK;
22:07:46  unset SSH_AGENT_PID;
22:07:46  echo Agent pid 15202 killed;
22:07:46  [ssh-agent] Stopped.
22:07:46  [PostBuildScript] - [INFO] Executing post build scripts.
22:07:46  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16864690153773337033.sh
22:07:46  ---> sysstat.sh
22:07:46  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9545517103305108683.sh
22:07:46  ---> package-listing.sh
22:07:46  ++ facter osfamily
22:07:46  ++ tr '[:upper:]' '[:lower:]'
22:07:46  + OS_FAMILY=redhat
22:07:46  + workspace=/w/workspace/ci-management-openstack-cron
22:07:46  + START_PACKAGES=/tmp/packages_start.txt
22:07:46  + END_PACKAGES=/tmp/packages_end.txt
22:07:46  + DIFF_PACKAGES=/tmp/packages_diff.txt
22:07:46  + PACKAGES=/tmp/packages_start.txt
22:07:46  + '[' /w/workspace/ci-management-openstack-cron ']'
22:07:46  + PACKAGES=/tmp/packages_end.txt
22:07:46  + case "${OS_FAMILY}" in
22:07:46  + rpm -qa
22:07:46  + sort
22:07:47  + '[' -f /tmp/packages_start.txt ']'
22:07:47  + '[' -f /tmp/packages_end.txt ']'
22:07:47  + diff /tmp/packages_start.txt /tmp/packages_end.txt
22:07:47  + '[' /w/workspace/ci-management-openstack-cron ']'
22:07:47  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
22:07:47  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
22:07:47  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3060204689435673980.sh
22:07:47  ---> capture-instance-metadata.sh
22:07:47  Setup pyenv:
22:07:47    system
22:07:47    3.8.13
22:07:47    3.9.13
22:07:47  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:47  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:07:47  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:47  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:07:49  lf-activate-venv(): INFO: Base packages installed successfully
22:07:49  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:07:58  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:07:58  INFO: Running in OpenStack, capturing instance metadata
22:07:58  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins754109890000397320.sh
22:07:58  provisioning config files...
22:07:58  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config17969396867499667970tmp
22:07:58  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
22:07:58  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
22:07:58  [EnvInject] - Injecting environment variables from a build step.
22:07:58  [EnvInject] - Injecting as environment variables the properties content 
22:07:58  SERVER_ID=logs
22:07:58  
22:07:58  [EnvInject] - Variables injected successfully.
22:07:58  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4066848500270763086.sh
22:07:58  ---> create-netrc.sh
22:07:58  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6737878732671751852.sh
22:07:58  ---> python-tools-install.sh
22:07:58  Setup pyenv:
22:07:58    system
22:07:58    3.8.13
22:07:58    3.9.13
22:07:58  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:58  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:07:58  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:58  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:08:00  lf-activate-venv(): INFO: Base packages installed successfully
22:08:00  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:08:09  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:08:09  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4544064349617265129.sh
22:08:09  ---> sudo-logs.sh
22:08:09  Archiving 'sudo' log..
22:08:09  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13160271108029700530.sh
22:08:09  ---> job-cost.sh
22:08:09  Setup pyenv:
22:08:09    system
22:08:09    3.8.13
22:08:09    3.9.13
22:08:09  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:10  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:08:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:10  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:08:12  lf-activate-venv(): INFO: Base packages installed successfully
22:08:12  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
22:08:26  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:08:26  INFO: No Stack...
22:08:27  INFO: Retrieving Pricing Info for: v3-standard-2
22:08:27  INFO: Archiving Costs
22:08:27  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins14072479907985716452.sh
22:08:27  ---> logs-deploy.sh
22:08:27  Setup pyenv:
22:08:27    system
22:08:27    3.8.13
22:08:27    3.9.13
22:08:27  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:27  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-dJlT from file:/tmp/.os_lf_venv
22:08:27  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:27  lf-activate-venv(): INFO: Attempting to install with network-safe options...
22:08:29  lf-activate-venv(): INFO: Base packages installed successfully
22:08:29  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:08:40  lf-activate-venv(): INFO: Adding /tmp/venv-dJlT/bin to PATH
22:08:40  INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/ci-management-openstack-cron/57247
22:08:40  INFO: archiving workspace using pattern(s): 
22:08:41  Archives upload complete.
22:08:41  INFO: archiving logs to Nexus
22:08:42  ---> uname -a:
22:08:42  Linux prd-centos8-builder-2c-1g-1893.novalocal 4.18.0-448.el8.x86_64 #1 SMP Wed Jan 18 15:02:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
22:08:42  
22:08:42  
22:08:42  ---> lscpu:
22:08:42  Architecture:        x86_64
22:08:42  CPU op-mode(s):      32-bit, 64-bit
22:08:42  Byte Order:          Little Endian
22:08:42  CPU(s):              2
22:08:42  On-line CPU(s) list: 0,1
22:08:42  Thread(s) per core:  1
22:08:42  Core(s) per socket:  1
22:08:42  Socket(s):           2
22:08:42  NUMA node(s):        1
22:08:42  Vendor ID:           AuthenticAMD
22:08:42  CPU family:          23
22:08:42  Model:               49
22:08:42  Model name:          AMD EPYC-Rome Processor
22:08:42  Stepping:            0
22:08:42  CPU MHz:             2800.000
22:08:42  BogoMIPS:            5600.00
22:08:42  Virtualization:      AMD-V
22:08:42  Hypervisor vendor:   KVM
22:08:42  Virtualization type: full
22:08:42  L1d cache:           32K
22:08:42  L1i cache:           32K
22:08:42  L2 cache:            512K
22:08:42  L3 cache:            16384K
22:08:42  NUMA node0 CPU(s):   0,1
22:08:42  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
22:08:42  
22:08:42  
22:08:42  ---> nproc:
22:08:42  2
22:08:42  
22:08:42  
22:08:42  ---> df -h:
22:08:42  Filesystem      Size  Used Avail Use% Mounted on
22:08:42  devtmpfs        3.8G     0  3.8G   0% /dev
22:08:42  tmpfs           3.8G     0  3.8G   0% /dev/shm
22:08:42  tmpfs           3.8G   17M  3.8G   1% /run
22:08:42  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
22:08:42  /dev/vda1        40G  8.4G   32G  21% /
22:08:42  tmpfs           770M     0  770M   0% /run/user/1001
22:08:42  
22:08:42  
22:08:42  ---> free -m:
22:08:42                total        used        free      shared  buff/cache   available
22:08:42  Mem:           7699         574        5027          19        2097        6819
22:08:42  Swap:          1023           0        1023
22:08:42  
22:08:42  
22:08:42  ---> ip addr:
22:08:42  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
22:08:42      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
22:08:42      inet 127.0.0.1/8 scope host lo
22:08:42         valid_lft forever preferred_lft forever
22:08:42      inet6 ::1/128 scope host 
22:08:42         valid_lft forever preferred_lft forever
22:08:42  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
22:08:42      link/ether fa:16:3e:68:15:35 brd ff:ff:ff:ff:ff:ff
22:08:42      altname enp0s3
22:08:42      altname ens3
22:08:42      inet 10.30.107.98/23 brd 10.30.107.255 scope global dynamic noprefixroute eth0
22:08:42         valid_lft 86087sec preferred_lft 86087sec
22:08:42      inet6 fe80::f816:3eff:fe68:1535/64 scope link 
22:08:42         valid_lft forever preferred_lft forever
22:08:42  
22:08:42  
22:08:42  ---> sar -b -r -n DEV:
22:08:42  Linux 4.18.0-448.el8.x86_64 (centos-stream-8-builder-63d9752a-2c92-2a07-2618-33e2bb46e6c7.nov) 	10/10/2025 	_x86_64_	(2 CPU)
22:08:42  
22:08:42  22:03:26     LINUX RESTART	(2 CPU)
22:08:42  
22:08:42  10:04:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
22:08:42  10:05:01 PM    329.30    120.21    209.08   1961.41   8512.01
22:08:42  10:06:01 PM     88.60      0.75     87.85     93.97   8890.89
22:08:42  10:07:01 PM     24.63      1.28     23.35    116.91    961.52
22:08:42  10:08:01 PM     22.65      0.27     22.38     25.20    925.85
22:08:42  Average:       116.29     30.63     85.67    549.35   4822.74
22:08:42  
22:08:42  10:04:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
22:08:42  10:05:01 PM   5158156   6972080   2726288     34.58      2688   1981024    759372      8.50    195024   2170512    219792
22:08:42  10:06:01 PM   5224308   7051060   2660136     33.74      2688   1992308    659952      7.39    225360   2064472     22388
22:08:42  10:07:01 PM   5111508   6940412   2772936     35.17      2688   1994556    759816      8.51    228516   2173188      7640
22:08:42  10:08:01 PM   5189156   7018724   2695288     34.18      2688   1995184    675908      7.57    397244   1926452      7492
22:08:42  Average:      5170782   6995569   2713662     34.42      2688   1990768    713762      7.99    261536   2083656     64328
22:08:42  
22:08:42  10:04:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
22:08:42  10:05:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:42  10:05:01 PM      eth0     88.15     59.54   1235.91     16.13      0.00      0.00      0.00      0.00
22:08:42  10:06:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:42  10:06:01 PM      eth0     23.41     21.56     47.46      7.83      0.00      0.00      0.00      0.00
22:08:42  10:07:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:42  10:07:01 PM      eth0     18.31     13.63     14.30      7.73      0.00      0.00      0.00      0.00
22:08:42  10:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:42  10:08:01 PM      eth0     18.80     16.05     14.45      8.02      0.00      0.00      0.00      0.00
22:08:42  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:08:42  Average:         eth0     37.17     27.69    328.02      9.93      0.00      0.00      0.00      0.00
22:08:42  
22:08:42  
22:08:42  ---> sar -P ALL:
22:08:42  Linux 4.18.0-448.el8.x86_64 (centos-stream-8-builder-63d9752a-2c92-2a07-2618-33e2bb46e6c7.nov) 	10/10/2025 	_x86_64_	(2 CPU)
22:08:42  
22:08:42  22:03:26     LINUX RESTART	(2 CPU)
22:08:42  
22:08:42  10:04:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
22:08:42  10:05:01 PM     all     37.20      2.39     18.88      5.60      0.13     35.80
22:08:42  10:05:01 PM       0     36.04      3.36     22.05      5.85      0.14     32.56
22:08:42  10:05:01 PM       1     38.35      1.42     15.72      5.36      0.12     39.03
22:08:42  10:06:01 PM     all     33.30      0.00      2.93      7.15      0.12     56.51
22:08:42  10:06:01 PM       0     36.40      0.00      2.95      6.36      0.12     54.17
22:08:42  10:06:01 PM       1     30.20      0.00      2.90      7.94      0.12     58.85
22:08:42  10:07:01 PM     all     18.72      0.00      1.14      5.91      0.08     74.14
22:08:42  10:07:01 PM       0     20.29      0.00      1.35      2.67      0.08     75.61
22:08:42  10:07:01 PM       1     17.16      0.00      0.93      9.15      0.08     72.67
22:08:42  10:08:01 PM     all     27.66      0.00      2.19      3.76      0.11     66.28
22:08:42  10:08:01 PM       0     27.07      0.00      2.02      4.00      0.12     66.80
22:08:42  10:08:01 PM       1     28.24      0.00      2.37      3.52      0.10     65.77
22:08:42  Average:        all     29.19      0.59      6.24      5.61      0.11     58.27
22:08:42  Average:          0     29.92      0.83      7.03      4.71      0.11     57.39
22:08:42  Average:          1     28.46      0.35      5.45      6.50      0.10     59.14
22:08:42  
22:08:42  
22:08:42