11:03:53  Started by timer
11:03:53  Running as SYSTEM
11:03:53  [EnvInject] - Loading node environment variables.
11:03:53  Building remotely on prd-centos8-builder-2c-1g-4146 (centos8-builder-2c-1g) in workspace /w/workspace/ci-management-openstack-cron
11:03:53  [ssh-agent] Looking for ssh-agent implementation...
11:03:53  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
11:03:53  $ ssh-agent
11:03:53  SSH_AUTH_SOCK=/tmp/ssh-i5WrhpyfHaWO/agent.14837
11:03:53  SSH_AGENT_PID=14838
11:03:53  [ssh-agent] Started.
11:03:53  Running ssh-add (command line suppressed)
11:03:53  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_4465598230336730902.key (/w/workspace/ci-management-openstack-cron@tmp/private_key_4465598230336730902.key)
11:03:53  [ssh-agent] Using credentials onap-jobbuiler (Gerrit user)
11:03:53  The recommended git tool is: NONE
11:03:55  using credential onap-jenkins-ssh
11:03:55  Wiping out workspace first.
11:03:55  Cloning the remote Git repository
11:03:55  Cloning repository git://cloud.onap.org/mirror/ci-management
11:03:55   > git init /w/workspace/ci-management-openstack-cron # timeout=10
11:03:55  Fetching upstream changes from git://cloud.onap.org/mirror/ci-management
11:03:55   > git --version # timeout=10
11:03:55   > git --version # 'git version 2.39.0'
11:03:55  using GIT_SSH to set credentials Gerrit user
11:03:55  [INFO] Currently running in a labeled security context
11:03:55  [INFO] Currently SELinux is 'enforcing' on the host
11:03:55   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh9879024270306015593.key
11:03:55  Verifying host key using manually-configured host key entries
11:03:55   > git fetch --tags --force --progress -- git://cloud.onap.org/mirror/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
11:03:56   > git config remote.origin.url git://cloud.onap.org/mirror/ci-management # timeout=10
11:03:56   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
11:03:57  Avoid second fetch
11:03:57   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
11:03:57  Checking out Revision 58929f9e6d4ad191a4e8dc5647b0bd11dd64d51e (refs/remotes/origin/master)
11:03:57   > git config core.sparsecheckout # timeout=10
11:03:57   > git checkout -f 58929f9e6d4ad191a4e8dc5647b0bd11dd64d51e # timeout=10
11:03:57  Commit message: "CI: Add trigger to support retesting"
11:03:57   > git rev-list --no-walk 58929f9e6d4ad191a4e8dc5647b0bd11dd64d51e # timeout=10
11:03:57   > git remote # timeout=10
11:03:57   > git submodule init # timeout=10
11:03:58   > git submodule sync # timeout=10
11:03:58   > git config --get remote.origin.url # timeout=10
11:03:58   > git submodule init # timeout=10
11:03:58   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
11:03:58   > git config --get submodule.global-jjb.url # timeout=10
11:03:58   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
11:03:58   > git config --get submodule.packer/common-packer.url # timeout=10
11:03:58   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
11:03:59   > git submodule update --init --recursive global-jjb # timeout=10
11:03:59   > git submodule update --init --recursive packer/common-packer # timeout=10
11:04:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
11:04:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
11:04:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
11:04:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
11:04:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
11:04:03  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
11:04:03  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
11:04:03  No emails were triggered.
11:04:03  provisioning config files...
11:04:03  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
11:04:03  copy managed file [npmrc] to file:/home/jenkins/.npmrc
11:04:03  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
11:04:03  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3675104697591204677.sh
11:04:03  ---> python-tools-install.sh
11:04:03  Setup pyenv:
11:04:03    system
11:04:03  * 3.8.13 (set by /opt/pyenv/version)
11:04:03  * 3.9.13 (set by /opt/pyenv/version)
11:04:03  * 3.10.6 (set by /opt/pyenv/version)
11:04:08  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-ZHhy
11:04:08  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
11:04:08  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:04:08  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:04:12  lf-activate-venv(): INFO: Base packages installed successfully
11:04:12  lf-activate-venv(): INFO: Installing additional packages: lftools 
11:04:47  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:04:47  Generating Requirements File
11:05:11  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
11:05:11  deprecated 1.2.18 requires wrapt<2,>=1.10, but you have wrapt 2.0.0 which is incompatible.
11:05:11  httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
11:05:11  Python 3.10.6
11:05:11  pip 25.2 from /tmp/venv-ZHhy/lib/python3.10/site-packages/pip (python 3.10)
11:05:12  appdirs==1.4.4
11:05:12  argcomplete==3.6.3
11:05:12  aspy.yaml==1.3.0
11:05:12  attrs==25.4.0
11:05:12  autopage==0.5.2
11:05:12  beautifulsoup4==4.14.2
11:05:12  boto3==1.40.55
11:05:12  botocore==1.40.55
11:05:12  bs4==0.0.2
11:05:12  cachetools==6.2.1
11:05:12  certifi==2025.10.5
11:05:12  cffi==2.0.0
11:05:12  cfgv==3.4.0
11:05:12  chardet==5.2.0
11:05:12  charset-normalizer==3.4.4
11:05:12  click==8.3.0
11:05:12  cliff==4.11.0
11:05:12  cmd2==2.7.0
11:05:12  cryptography==3.3.2
11:05:12  debtcollector==3.0.0
11:05:12  decorator==5.2.1
11:05:12  defusedxml==0.7.1
11:05:12  Deprecated==1.2.18
11:05:12  distlib==0.4.0
11:05:12  dnspython==2.8.0
11:05:12  docker==7.1.0
11:05:12  dogpile.cache==1.5.0
11:05:12  durationpy==0.10
11:05:12  email-validator==2.3.0
11:05:12  filelock==3.20.0
11:05:12  future==1.0.0
11:05:12  gitdb==4.0.12
11:05:12  GitPython==3.1.45
11:05:12  google-auth==2.41.1
11:05:12  httplib2==0.31.0
11:05:12  identify==2.6.15
11:05:12  idna==3.11
11:05:12  importlib-resources==1.5.0
11:05:12  iso8601==2.1.0
11:05:12  Jinja2==3.1.6
11:05:12  jmespath==1.0.1
11:05:12  jsonpatch==1.33
11:05:12  jsonpointer==3.0.0
11:05:12  jsonschema==4.25.1
11:05:12  jsonschema-specifications==2025.9.1
11:05:12  keystoneauth1==5.12.0
11:05:12  kubernetes==34.1.0
11:05:12  lftools==0.37.15
11:05:12  lxml==6.0.2
11:05:12  markdown-it-py==4.0.0
11:05:12  MarkupSafe==3.0.3
11:05:12  mdurl==0.1.2
11:05:12  msgpack==1.1.2
11:05:12  multi_key_dict==2.0.3
11:05:12  munch==4.0.0
11:05:12  netaddr==1.3.0
11:05:12  niet==1.4.2
11:05:12  nodeenv==1.9.1
11:05:12  oauth2client==4.1.3
11:05:12  oauthlib==3.3.1
11:05:12  openstacksdk==4.7.1
11:05:12  os-service-types==1.8.0
11:05:12  osc-lib==4.2.0
11:05:12  oslo.config==10.0.0
11:05:12  oslo.context==6.1.0
11:05:12  oslo.i18n==6.6.0
11:05:12  oslo.log==7.2.1
11:05:12  oslo.serialization==5.8.0
11:05:12  oslo.utils==9.1.0
11:05:12  packaging==25.0
11:05:12  pbr==7.0.1
11:05:12  platformdirs==4.5.0
11:05:12  prettytable==3.16.0
11:05:12  psutil==7.1.1
11:05:12  pyasn1==0.6.1
11:05:12  pyasn1_modules==0.4.2
11:05:12  pycparser==2.23
11:05:12  pygerrit2==2.0.15
11:05:12  PyGithub==2.8.1
11:05:12  Pygments==2.19.2
11:05:12  PyJWT==2.10.1
11:05:12  PyNaCl==1.6.0
11:05:12  pyparsing==2.4.7
11:05:12  pyperclip==1.11.0
11:05:12  pyrsistent==0.20.0
11:05:12  python-cinderclient==9.8.0
11:05:12  python-dateutil==2.9.0.post0
11:05:12  python-heatclient==4.3.0
11:05:12  python-jenkins==1.8.3
11:05:12  python-keystoneclient==5.7.0
11:05:12  python-magnumclient==4.9.0
11:05:12  python-openstackclient==8.2.0
11:05:12  python-swiftclient==4.8.0
11:05:12  PyYAML==6.0.3
11:05:12  referencing==0.37.0
11:05:12  requests==2.32.5
11:05:12  requests-oauthlib==2.0.0
11:05:12  requestsexceptions==1.4.0
11:05:12  rfc3986==2.0.0
11:05:12  rich==14.2.0
11:05:12  rich-argparse==1.7.1
11:05:12  rpds-py==0.27.1
11:05:12  rsa==4.9.1
11:05:12  ruamel.yaml==0.18.15
11:05:12  ruamel.yaml.clib==0.2.14
11:05:12  s3transfer==0.14.0
11:05:12  simplejson==3.20.2
11:05:12  six==1.17.0
11:05:12  smmap==5.0.2
11:05:12  soupsieve==2.8
11:05:12  stevedore==5.5.0
11:05:12  tabulate==0.9.0
11:05:12  toml==0.10.2
11:05:12  tomlkit==0.13.3
11:05:12  tqdm==4.67.1
11:05:12  typing_extensions==4.15.0
11:05:12  tzdata==2025.2
11:05:12  urllib3==1.26.20
11:05:12  virtualenv==20.35.3
11:05:12  wcwidth==0.2.14
11:05:12  websocket-client==1.9.0
11:05:12  wrapt==2.0.0
11:05:12  xdg==6.0.0
11:05:12  xmltodict==1.0.2
11:05:12  yq==3.4.3
11:05:12  [EnvInject] - Injecting environment variables from a build step.
11:05:12  [EnvInject] - Injecting as environment variables the properties content 
11:05:12  OS_CLOUD=vex
11:05:12  
11:05:12  [EnvInject] - Variables injected successfully.
11:05:12  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
11:05:12  Run condition [Boolean condition] enabling perform for step [Execute shell]
11:05:12  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7155031677825172241.sh
11:05:12  ---> Orphaned k8s clusters
11:05:12  Setup pyenv:
11:05:12    system
11:05:12    3.8.13
11:05:12    3.9.13
11:05:12  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:05:12  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:05:12  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:05:12  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:05:14  lf-activate-venv(): INFO: Base packages installed successfully
11:05:14  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
11:05:20  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
11:05:20  lftools 0.37.15 requires urllib3<2.1.0, but you have urllib3 2.3.0 which is incompatible.
11:05:20  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:05:23  -----> Delete orphaned cluster
11:05:23  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
11:05:23  Run condition [Boolean condition] enabling perform for step [Execute shell]
11:05:23  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11078418654085219643.sh
11:05:23  ---> Orphaned stacks
11:05:23  Setup pyenv:
11:05:23    system
11:05:23    3.8.13
11:05:23    3.9.13
11:05:23  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:05:23  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:05:23  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:05:23  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:05:25  lf-activate-venv(): INFO: Base packages installed successfully
11:05:25  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
11:05:39  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:05:39  + mapfile -t OS_COE_CLUSTERS_ID
11:05:39  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
11:05:39  ++ awk '{print $1}'
11:05:39  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
11:05:42  + echo '-----> Active clusters -> stacks'
11:05:42  -----> Active clusters -> stacks
11:05:42  + OS_COE_STACKS=()
11:05:42  + [[ 0 -gt 0 ]]
11:05:42  + mapfile -t OS_STACKS
11:05:42  ++ awk '{print $1}'
11:05:42  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
11:05:43  + echo '-----> Active stacks'
11:05:43  -----> Active stacks
11:05:43  + echo '-----> Delete orphaned stacks'
11:05:43  -----> Delete orphaned stacks
11:05:43  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
11:05:43  Run condition [Boolean condition] enabling perform for step [Execute shell]
11:05:43  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2033035306349384165.sh
11:05:43  ---> Orphaned servers
11:05:43  Setup pyenv:
11:05:43    system
11:05:43    3.8.13
11:05:43    3.9.13
11:05:43  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:05:43  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:05:43  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:05:43  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:05:45  lf-activate-venv(): INFO: Base packages installed successfully
11:05:45  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
11:05:56  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:05:59  -----> Active servers
11:05:59  prd-centos8-builder-2c-1g-4146
11:05:59  prd-ubuntu1804-docker-8c-8g-4145
11:05:59  prd-ubuntu1804-docker-8c-8g-4143
11:05:59  prd-queue-docker-4c-4g-2431
11:05:59  -----> Delete orphaned servers
11:06:00  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
11:06:00  Run condition [Boolean condition] enabling perform for step [Execute shell]
11:06:00  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16091404943149562550.sh
11:06:00  ---> Orphaned ports
11:06:00  Setup pyenv:
11:06:00    system
11:06:00    3.8.13
11:06:00    3.9.13
11:06:00  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:06:00  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:06:00  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:06:00  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:06:02  lf-activate-venv(): INFO: Base packages installed successfully
11:06:02  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] python-openstackclient 
11:06:12  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:06:14  No orphaned ports to process.
11:06:14  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
11:06:14  Run condition [Boolean condition] enabling perform for step [Execute shell]
11:06:14  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins14097431156852869413.sh
11:06:14  ---> Orphaned volumes
11:06:14  + source /home/jenkins/lf-env.sh
11:06:14  + lf-activate-venv --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
11:06:14  ++ mktemp -d /tmp/venv-XXXX
11:06:14  + lf_venv=/tmp/venv-dPJ3
11:06:14  + local venv_file=/tmp/.os_lf_venv
11:06:14  + local python=python3
11:06:14  + local options
11:06:14  + local set_path=true
11:06:14  + local install_args=
11:06:14  ++ getopt -o np:v: -l no-path,system-site-packages,python:,venv-file: -n lf-activate-venv -- --python python3 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
11:06:14  + options=' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
11:06:14  + eval set -- ' --python '\''python3'\'' -- '\''lftools[openstack]'\'' '\''kubernetes'\'' '\''niet'\'' '\''python-heatclient'\'' '\''python-openstackclient'\'' '\''python-magnumclient'\'' '\''yq'\'''
11:06:14  ++ set -- --python python3 -- 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
11:06:14  + true
11:06:14  + case $1 in
11:06:14  + python=python3
11:06:14  + shift 2
11:06:14  + true
11:06:14  + case $1 in
11:06:14  + shift
11:06:14  + break
11:06:14  + case $python in
11:06:14  + local pkg_list=
11:06:14  + [[ -d /opt/pyenv ]]
11:06:14  + echo 'Setup pyenv:'
11:06:14  Setup pyenv:
11:06:14  + export PYENV_ROOT=/opt/pyenv
11:06:14  + PYENV_ROOT=/opt/pyenv
11:06:14  + export PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
11:06:14  + PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
11:06:14  + pyenv versions
11:06:14    system
11:06:14    3.8.13
11:06:14    3.9.13
11:06:14  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:06:14  + command -v pyenv
11:06:14  ++ pyenv init - --no-rehash
11:06:14  + eval 'PATH="$(bash --norc -ec '\''IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "'\''/opt/pyenv/shims'\''" ]]; then unset '\''\'\'''\''paths[i]'\''\'\'''\''; fi; done; echo "${paths[*]}"'\'')"
11:06:14  export PATH="/opt/pyenv/shims:${PATH}"
11:06:14  export PYENV_SHELL=bash
11:06:14  source '\''/opt/pyenv/libexec/../completions/pyenv.bash'\''
11:06:14  pyenv() {
11:06:14    local command
11:06:14    command="${1:-}"
11:06:14    if [ "$#" -gt 0 ]; then
11:06:14      shift
11:06:14    fi
11:06:14  
11:06:14    case "$command" in
11:06:14    rehash|shell)
11:06:14      eval "$(pyenv "sh-$command" "$@")"
11:06:14      ;;
11:06:14    *)
11:06:14      command pyenv "$command" "$@"
11:06:14      ;;
11:06:14    esac
11:06:14  }'
11:06:14  +++ bash --norc -ec 'IFS=:; paths=($PATH); for i in ${!paths[@]}; do if [[ ${paths[i]} == "/opt/pyenv/shims" ]]; then unset '\''paths[i]'\''; fi; done; echo "${paths[*]}"'
11:06:14  ++ PATH=/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
11:06:14  ++ export PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
11:06:14  ++ PATH=/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
11:06:14  ++ export PYENV_SHELL=bash
11:06:14  ++ PYENV_SHELL=bash
11:06:14  ++ source /opt/pyenv/libexec/../completions/pyenv.bash
11:06:14  +++ complete -F _pyenv pyenv
11:06:14  ++ lf-pyver python3
11:06:14  ++ local py_version_xy=python3
11:06:14  ++ local py_version_xyz=
11:06:14  ++ pyenv versions
11:06:14  ++ local command
11:06:14  ++ command=versions
11:06:14  ++ awk '{ print $1 }'
11:06:14  ++ '[' 1 -gt 0 ']'
11:06:14  ++ shift
11:06:14  ++ case "$command" in
11:06:14  ++ command pyenv versions
11:06:14  ++ pyenv versions
11:06:14  ++ sed 's/^[ *]* //'
11:06:14  ++ grep -E '^[0-9.]*[0-9]$'
11:06:14  ++ [[ ! -s /tmp/.pyenv_versions ]]
11:06:14  +++ grep '^3' /tmp/.pyenv_versions
11:06:14  +++ tail -n 1
11:06:14  +++ sort -V
11:06:14  ++ py_version_xyz=3.10.6
11:06:14  ++ [[ -z 3.10.6 ]]
11:06:14  ++ echo 3.10.6
11:06:14  ++ return 0
11:06:14  + pyenv local 3.10.6
11:06:14  + local command
11:06:14  + command=local
11:06:14  + '[' 2 -gt 0 ']'
11:06:14  + shift
11:06:14  + case "$command" in
11:06:14  + command pyenv local 3.10.6
11:06:14  + pyenv local 3.10.6
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='lftools[openstack] '
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='kubernetes '
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='niet '
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='python-heatclient '
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='python-openstackclient '
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='python-magnumclient '
11:06:14  + for arg in "$@"
11:06:14  + case $arg in
11:06:14  + pkg_list+='yq '
11:06:14  + [[ -f /tmp/.os_lf_venv ]]
11:06:14  ++ cat /tmp/.os_lf_venv
11:06:14  + lf_venv=/tmp/venv-ZHhy
11:06:14  + echo 'lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from' file:/tmp/.os_lf_venv
11:06:14  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:06:14  + echo 'lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)'
11:06:14  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:06:14  + local 'pip_opts=--upgrade --quiet'
11:06:14  + pip_opts='--upgrade --quiet --trusted-host pypi.org'
11:06:14  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org'
11:06:14  + pip_opts='--upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org'
11:06:14  + [[ -n '' ]]
11:06:14  + [[ -n '' ]]
11:06:14  + echo 'lf-activate-venv(): INFO: Attempting to install with network-safe options...'
11:06:14  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:06:14  + /tmp/venv-ZHhy/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org pip 'setuptools<66' virtualenv
11:06:16  + echo 'lf-activate-venv(): INFO: Base packages installed successfully'
11:06:16  lf-activate-venv(): INFO: Base packages installed successfully
11:06:16  + [[ -z lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq  ]]
11:06:16  + echo 'lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq '
11:06:16  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
11:06:16  + /tmp/venv-ZHhy/bin/python3 -m pip install --upgrade --quiet --trusted-host pypi.org --trusted-host files.pythonhosted.org --trusted-host pypi.python.org --upgrade-strategy eager 'lftools[openstack]' kubernetes niet python-heatclient python-openstackclient python-magnumclient yq
11:06:27  + type python3
11:06:27  + true
11:06:27  + echo 'lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH'
11:06:27  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:06:27  + PATH=/tmp/venv-ZHhy/bin:/opt/pyenv/shims:/opt/pyenv/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
11:06:27  + return 0
11:06:27  + mapfile -t os_volumes
11:06:27  ++ openstack --os-cloud vex volume list -f value -c ID --status Available
11:06:30  + '[' 0 -eq 0 ']'
11:06:30  + echo 'No orphaned volumes found.'
11:06:30  No orphaned volumes found.
11:06:30  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
11:06:30  Run condition [Boolean condition] enabling perform for step [Execute shell]
11:06:30  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12009300138360478058.sh
11:06:30  ---> Protect in-use images
11:06:30  Setup pyenv:
11:06:30    system
11:06:30    3.8.13
11:06:30    3.9.13
11:06:30  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:06:30  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:06:30  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:06:30  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:06:32  lf-activate-venv(): INFO: Base packages installed successfully
11:06:32  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes python-heatclient python-openstackclient 
11:06:42  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:06:42  INFO: There are images to protect defined in jenkins-config.
11:06:42  INFO: Protecting the following images:
11:06:42  CentOS Stream 8 - redis -  - 310180101-1010
11:06:42  Ubuntu 20.04 - memcached - x86_64 - 160580505-5011
11:06:42  ZZCI - CentOS 7 - builder - x86_64 - 20211001-132245.747
11:06:42  ZZCI - CentOS 7 - docker - x86_64 - 20220919-201912.261
11:06:42  ZZCI - CentOS Stream 8 - builder - x86_64 - 20230131-200810.126
11:06:42  ZZCI - CentOS Stream 8 - docker - x86_64 - 20230215-011800.297
11:06:42  ZZCI - Ubuntu 18.04 - builder - x86_64 - 20221013-041722.509
11:06:42  ZZCI - Ubuntu 18.04 - docker - x86_64 - 20220919-185927.020
11:06:42  ZZCI - Ubuntu 20.04 - builder - x86_64 - 20230412-164405.694
11:06:42  ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-103335.070
11:06:42  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20220919-201946.022
11:06:42  ZZCI - Ubuntu 20.04 - docker - x86_64 - 20230414-200946.220
11:06:42  ZZCI - Ubuntu 20.04 - helm - x86_64 - 20230405-210810.069
11:06:42  ZZCI - Ubuntu 22.04 - builder - x86_64 - 20250424-093435.248
11:06:42  ZZCI - Ubuntu 22.04 - docker - x86_64 - 20250623-071957.883
11:06:43  Protected setting for CentOS Stream 8 - redis -  - 310180101-1010: True
11:06:45  Protected setting for Ubuntu 20.04 - memcached - x86_64 - 160580505-5011: True
11:06:46  No Image found for ZZCI - CentOS 7 - builder - x86_64 - 20211001-132245.747
11:06:46  Build step 'Conditional step (single)' marked build as failure
11:06:46  $ ssh-agent -k
11:06:46  unset SSH_AUTH_SOCK;
11:06:46  unset SSH_AGENT_PID;
11:06:46  echo Agent pid 14838 killed;
11:06:46  [ssh-agent] Stopped.
11:06:46  [PostBuildScript] - [INFO] Executing post build scripts.
11:06:46  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13949159869578069022.sh
11:06:46  ---> sysstat.sh
11:06:47  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14609524937279688347.sh
11:06:47  ---> package-listing.sh
11:06:47  ++ facter osfamily
11:06:47  ++ tr '[:upper:]' '[:lower:]'
11:06:47  + OS_FAMILY=redhat
11:06:47  + workspace=/w/workspace/ci-management-openstack-cron
11:06:47  + START_PACKAGES=/tmp/packages_start.txt
11:06:47  + END_PACKAGES=/tmp/packages_end.txt
11:06:47  + DIFF_PACKAGES=/tmp/packages_diff.txt
11:06:47  + PACKAGES=/tmp/packages_start.txt
11:06:47  + '[' /w/workspace/ci-management-openstack-cron ']'
11:06:47  + PACKAGES=/tmp/packages_end.txt
11:06:47  + case "${OS_FAMILY}" in
11:06:47  + rpm -qa
11:06:47  + sort
11:06:47  + '[' -f /tmp/packages_start.txt ']'
11:06:47  + '[' -f /tmp/packages_end.txt ']'
11:06:47  + diff /tmp/packages_start.txt /tmp/packages_end.txt
11:06:47  + '[' /w/workspace/ci-management-openstack-cron ']'
11:06:47  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
11:06:47  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
11:06:47  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7717588166560057870.sh
11:06:47  ---> capture-instance-metadata.sh
11:06:48  Setup pyenv:
11:06:48    system
11:06:48    3.8.13
11:06:48    3.9.13
11:06:48  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:06:48  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:06:48  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:06:48  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:06:49  lf-activate-venv(): INFO: Base packages installed successfully
11:06:49  lf-activate-venv(): INFO: Installing additional packages: lftools 
11:06:57  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:06:58  INFO: Running in OpenStack, capturing instance metadata
11:06:58  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12755555354767399332.sh
11:06:58  provisioning config files...
11:06:58  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config4679137312641832617tmp
11:06:58  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
11:06:58  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
11:06:58  [EnvInject] - Injecting environment variables from a build step.
11:06:58  [EnvInject] - Injecting as environment variables the properties content 
11:06:58  SERVER_ID=logs
11:06:58  
11:06:58  [EnvInject] - Variables injected successfully.
11:06:58  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7564312070727377388.sh
11:06:58  ---> create-netrc.sh
11:06:58  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7634148057440054295.sh
11:06:58  ---> python-tools-install.sh
11:06:58  Setup pyenv:
11:06:58    system
11:06:58    3.8.13
11:06:58    3.9.13
11:06:58  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:06:58  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:06:58  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:06:58  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:07:00  lf-activate-venv(): INFO: Base packages installed successfully
11:07:00  lf-activate-venv(): INFO: Installing additional packages: lftools 
11:07:08  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:07:08  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14274026234818616407.sh
11:07:08  ---> sudo-logs.sh
11:07:08  Archiving 'sudo' log..
11:07:09  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1666464635113200885.sh
11:07:09  ---> job-cost.sh
11:07:09  Setup pyenv:
11:07:09    system
11:07:09    3.8.13
11:07:09    3.9.13
11:07:09  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:07:09  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:07:09  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:07:09  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:07:11  lf-activate-venv(): INFO: Base packages installed successfully
11:07:11  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
11:07:16  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
11:07:16  deprecated 1.2.18 requires wrapt<2,>=1.10, but you have wrapt 2.0.0 which is incompatible.
11:07:17  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:07:17  INFO: No Stack...
11:07:17  INFO: Retrieving Pricing Info for: v3-standard-2
11:07:17  INFO: Archiving Costs
11:07:17  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17975332695469013363.sh
11:07:17  ---> logs-deploy.sh
11:07:17  Setup pyenv:
11:07:18    system
11:07:18    3.8.13
11:07:18    3.9.13
11:07:18  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
11:07:18  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-ZHhy from file:/tmp/.os_lf_venv
11:07:18  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
11:07:18  lf-activate-venv(): INFO: Attempting to install with network-safe options...
11:07:19  lf-activate-venv(): INFO: Base packages installed successfully
11:07:19  lf-activate-venv(): INFO: Installing additional packages: lftools 
11:07:28  lf-activate-venv(): INFO: Adding /tmp/venv-ZHhy/bin to PATH
11:07:28  INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/ci-management-openstack-cron/57500
11:07:28  INFO: archiving workspace using pattern(s): 
11:07:29  Archives upload complete.
11:07:29  INFO: archiving logs to Nexus
11:07:30  ---> uname -a:
11:07:30  Linux prd-centos8-builder-2c-1g-4146.novalocal 4.18.0-448.el8.x86_64 #1 SMP Wed Jan 18 15:02:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
11:07:30  
11:07:30  
11:07:30  ---> lscpu:
11:07:30  Architecture:        x86_64
11:07:30  CPU op-mode(s):      32-bit, 64-bit
11:07:30  Byte Order:          Little Endian
11:07:30  CPU(s):              2
11:07:30  On-line CPU(s) list: 0,1
11:07:30  Thread(s) per core:  1
11:07:30  Core(s) per socket:  1
11:07:30  Socket(s):           2
11:07:30  NUMA node(s):        1
11:07:30  Vendor ID:           AuthenticAMD
11:07:30  CPU family:          23
11:07:30  Model:               49
11:07:30  Model name:          AMD EPYC-Rome Processor
11:07:30  Stepping:            0
11:07:30  CPU MHz:             2799.998
11:07:30  BogoMIPS:            5599.99
11:07:30  Virtualization:      AMD-V
11:07:30  Hypervisor vendor:   KVM
11:07:30  Virtualization type: full
11:07:30  L1d cache:           32K
11:07:30  L1i cache:           32K
11:07:30  L2 cache:            512K
11:07:30  L3 cache:            16384K
11:07:30  NUMA node0 CPU(s):   0,1
11:07:30  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
11:07:30  
11:07:30  
11:07:30  ---> nproc:
11:07:30  2
11:07:30  
11:07:30  
11:07:30  ---> df -h:
11:07:30  Filesystem      Size  Used Avail Use% Mounted on
11:07:30  devtmpfs        3.8G     0  3.8G   0% /dev
11:07:30  tmpfs           3.8G     0  3.8G   0% /dev/shm
11:07:30  tmpfs           3.8G   17M  3.8G   1% /run
11:07:30  tmpfs           3.8G     0  3.8G   0% /sys/fs/cgroup
11:07:30  /dev/vda1        40G  8.4G   32G  21% /
11:07:30  tmpfs           770M     0  770M   0% /run/user/1001
11:07:30  
11:07:30  
11:07:30  ---> free -m:
11:07:30                total        used        free      shared  buff/cache   available
11:07:30  Mem:           7699         557        5046          19        2095        6835
11:07:30  Swap:          1023           0        1023
11:07:30  
11:07:30  
11:07:30  ---> ip addr:
11:07:30  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
11:07:30      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
11:07:30      inet 127.0.0.1/8 scope host lo
11:07:30         valid_lft forever preferred_lft forever
11:07:30      inet6 ::1/128 scope host 
11:07:30         valid_lft forever preferred_lft forever
11:07:30  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1458 qdisc mq state UP group default qlen 1000
11:07:30      link/ether fa:16:3e:04:95:e3 brd ff:ff:ff:ff:ff:ff
11:07:30      altname enp0s3
11:07:30      altname ens3
11:07:30      inet 10.30.106.84/23 brd 10.30.107.255 scope global dynamic noprefixroute eth0
11:07:30         valid_lft 86159sec preferred_lft 86159sec
11:07:30      inet6 fe80::f816:3eff:fe04:95e3/64 scope link 
11:07:30         valid_lft forever preferred_lft forever
11:07:30  
11:07:30  
11:07:30  ---> sar -b -r -n DEV:
11:07:30  Linux 4.18.0-448.el8.x86_64 (centos-stream-8-builder-63d9752a-2c92-2a07-2618-33e2bb46e6c7.nov) 	10/21/2025 	_x86_64_	(2 CPU)
11:07:30  
11:07:30  11:03:24     LINUX RESTART	(2 CPU)
11:07:30  
11:07:30  11:04:03 AM       tps      rtps      wtps   bread/s   bwrtn/s
11:07:30  11:05:01 AM    235.33    110.07    125.27   1878.94   7586.90
11:07:30  11:06:01 AM     98.58      0.72     97.87     93.45   9168.66
11:07:30  11:07:01 AM     33.44      0.37     33.07     28.79   1298.30
11:07:30  Average:       121.19     36.23     84.95    653.48   6000.15
11:07:30  
11:07:30  11:04:03 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
11:07:30  11:05:01 AM   5321008   7058176   2563428     32.51      2688   1909668    676932      7.58    194648   2025524    161460
11:07:30  11:06:01 AM   5229272   7055940   2655164     33.68      2688   1992620    654380      7.33    224772   2058992     22756
11:07:30  11:07:01 AM   5200764   7027140   2683672     34.04      2688   1992080    699216      7.83    394860   1916612      7516
11:07:30  Average:      5250348   7047085   2634088     33.41      2688   1964789    676843      7.58    271427   2000376     63911
11:07:30  
11:07:30  11:04:03 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
11:07:30  11:05:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
11:07:30  11:05:01 AM      eth0     60.74     45.59   1011.09      8.52      0.00      0.00      0.00      0.00
11:07:30  11:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
11:07:30  11:06:01 AM      eth0     31.78     27.83    198.94      9.73      0.00      0.00      0.00      0.00
11:07:30  11:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
11:07:30  11:07:01 AM      eth0     27.92     23.39     21.42     14.49      0.00      0.00      0.00      0.00
11:07:30  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
11:07:30  Average:         eth0     39.92     32.12    403.75     10.94      0.00      0.00      0.00      0.00
11:07:30  
11:07:30  
11:07:30  ---> sar -P ALL:
11:07:30  Linux 4.18.0-448.el8.x86_64 (centos-stream-8-builder-63d9752a-2c92-2a07-2618-33e2bb46e6c7.nov) 	10/21/2025 	_x86_64_	(2 CPU)
11:07:30  
11:07:30  11:03:24     LINUX RESTART	(2 CPU)
11:07:30  
11:07:30  11:04:03 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
11:07:30  11:05:01 AM     all     29.04      1.91     17.07     15.12      0.11     36.74
11:07:30  11:05:01 AM       0     35.56      1.80     18.18     15.65      0.12     28.69
11:07:30  11:05:01 AM       1     22.53      2.03     15.96     14.59      0.10     44.79
11:07:30  11:06:01 AM     all     38.44      0.00      3.38      1.71      0.11     56.36
11:07:30  11:06:01 AM       0     46.88      0.00      3.65      2.13      0.10     47.24
11:07:30  11:06:01 AM       1     29.99      0.00      3.12      1.28      0.12     65.49
11:07:30  11:07:01 AM     all     41.74      0.00      2.83      0.40      0.09     54.94
11:07:30  11:07:01 AM       0     58.93      0.00      2.81      0.60      0.08     37.58
11:07:30  11:07:01 AM       1     24.59      0.00      2.84      0.20      0.10     72.27
11:07:30  Average:        all     36.53      0.62      7.61      5.59      0.10     49.55
11:07:30  Average:          0     47.31      0.58      8.05      5.97      0.10     37.98
11:07:30  Average:          1     25.75      0.65      7.16      5.21      0.11     61.12
11:07:30  
11:07:30  
11:07:30