Triggered by Gerrit: https://gerrit.onap.org/r/c/multicloud/k8s/+/142052 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-ubuntu1804-docker-8c-8g-46170 (ubuntu1804-docker-8c-8g) in workspace /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-wlOEgkV8Vlwy/agent.2072 SSH_AGENT_PID=2074 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell@tmp/private_key_10599729323880582542.key (/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell@tmp/private_key_10599729323880582542.key) [ssh-agent] Using credentials onap-jobbuiler (Gerrit user) The recommended git tool is: NONE using credential onap-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://cloud.onap.org/mirror/multicloud/k8s.git > git init /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell # timeout=10 Fetching upstream changes from git://cloud.onap.org/mirror/multicloud/k8s.git > git --version # timeout=10 > git --version # 'git version 2.17.1' using GIT_SSH to set credentials Gerrit user Verifying host key using manually-configured host key entries > git fetch --tags --progress -- git://cloud.onap.org/mirror/multicloud/k8s.git +refs/heads/*:refs/remotes/origin/* # timeout=30 > git config remote.origin.url git://cloud.onap.org/mirror/multicloud/k8s.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://cloud.onap.org/mirror/multicloud/k8s.git # timeout=10 Fetching upstream changes from git://cloud.onap.org/mirror/multicloud/k8s.git using GIT_SSH to set credentials Gerrit user Verifying host key using manually-configured host key entries > git fetch --tags --progress -- git://cloud.onap.org/mirror/multicloud/k8s.git refs/changes/52/142052/13 # timeout=30 > git rev-parse 68c9e253f4c51d0d8461e7fad285272f10ce6e9f^{commit} # timeout=10 JENKINS-19022: warning: possible memory leak due to Git plugin usage; see: https://plugins.jenkins.io/git/#remove-git-plugin-buildsbybranch-builddata-script Checking out Revision 68c9e253f4c51d0d8461e7fad285272f10ce6e9f (refs/changes/52/142052/13) > git config core.sparsecheckout # timeout=10 > git checkout -f 68c9e253f4c51d0d8461e7fad285272f10ce6e9f # timeout=30 Commit message: "Use k3s in pipeline" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 3d913a2ed4348d45c8685bc065022e425c982810 # timeout=10 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins9064860168503539308.sh + cd ./kud/ci + bash -x ./kud-installer.sh + set -x -e -o pipefail +++ dirname ./kud-installer.sh ++ readlink -f . + curr_dir=/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/kud/ci + cd /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/kud/ci/../hosting_providers/baremetal + export 'KUD_ADDONS=virtlet ovn4nfv' + KUD_ADDONS='virtlet ovn4nfv' + ./aio.sh Preparing inventory for ansible Allowing present ~/.ssh/id_rsa key to be used for login to this host Enabling nested-virtualization Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease [242 kB] Get:2 https://dl.google.com/linux/chrome/deb stable InRelease [1825 B] Get:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [102 kB] Get:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [102 kB] Get:5 https://download.docker.com/linux/ubuntu bionic InRelease [64.4 kB] Get:6 http://security.ubuntu.com/ubuntu bionic-security InRelease [102 kB] Hit:7 http://ppa.launchpad.net/ansible/ansible/ubuntu bionic InRelease Get:8 http://apt.puppetlabs.com xenial InRelease [144 kB] Err:2 https://dl.google.com/linux/chrome/deb stable InRelease The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 32EE5355A6BC6E42 Get:9 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease [15.9 kB] Get:10 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1019 kB] Get:11 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic InRelease [21.5 kB] Get:12 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main Translation-en [516 kB] Get:13 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [9184 B] Get:14 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/restricted Translation-en [3584 B] Get:15 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [8570 kB] Get:16 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/universe Translation-en [4941 kB] Get:17 https://download.docker.com/linux/ubuntu bionic/stable amd64 Packages [39.0 kB] Get:18 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [151 kB] Get:19 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/multiverse Translation-en [108 kB] Get:20 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3045 kB] Get:21 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [554 kB] Get:22 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1347 kB] Get:23 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [187 kB] Get:24 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1915 kB] Get:25 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [421 kB] Get:26 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [25.6 kB] Get:27 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6088 B] Get:28 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [53.3 kB] Get:29 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/main Translation-en [14.6 kB] Get:30 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [18.2 kB] Get:31 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [8668 B] Err:8 http://apt.puppetlabs.com xenial InRelease The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) Get:32 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main amd64 Packages [524 B] Get:33 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main Translation-en [416 B] Get:34 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2717 kB] Get:35 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic/main amd64 Packages [14.0 kB] Get:36 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic/main Translation-en [1008 B] Get:37 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [468 kB] Get:38 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1317 kB] Get:39 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [182 kB] Get:40 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1303 kB] Get:41 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [308 kB] Get:42 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.8 kB] Get:43 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [3928 B] Fetched 30.1 MB in 5s (6235 kB/s) Reading package lists... W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://dl.google.com/linux/chrome/deb stable InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 32EE5355A6BC6E42 W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://apt.puppetlabs.com xenial InRelease: The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) W: Failed to fetch https://dl.google.com/linux/chrome/deb/dists/stable/InRelease The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 32EE5355A6BC6E42 W: Failed to fetch http://apt.puppetlabs.com/dists/xenial/InRelease The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) W: Some index files failed to download. They have been ignored, or old ones used instead. Reading package lists... Building dependency tree... Reading state information... The following packages were automatically installed and are no longer required: libmysqlclient20 mysql-common Use 'sudo apt autoremove' to remove them. The following additional packages will be installed: msr-tools The following NEW packages will be installed: cpu-checker msr-tools 0 upgraded, 2 newly installed, 0 to remove and 207 not upgraded. Need to get 16.6 kB of archives. After this operation, 62.5 kB of additional disk space will be used. Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 msr-tools amd64 1.3-2build1 [9760 B] Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 cpu-checker amd64 0.7-0ubuntu7 [6862 B] debconf: unable to initialize frontend: Dialog debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) debconf: falling back to frontend: Readline debconf: unable to initialize frontend: Readline debconf: (This frontend requires a controlling tty.) debconf: falling back to frontend: Teletype dpkg-preconfigure: unable to re-open stdin: Fetched 16.6 kB in 0s (328 kB/s) Selecting previously unselected package msr-tools. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 203834 files and directories currently installed.) Preparing to unpack .../msr-tools_1.3-2build1_amd64.deb ... Unpacking msr-tools (1.3-2build1) ... Selecting previously unselected package cpu-checker. Preparing to unpack .../cpu-checker_0.7-0ubuntu7_amd64.deb ... Unpacking cpu-checker (0.7-0ubuntu7) ... Setting up msr-tools (1.3-2build1) ... Setting up cpu-checker (0.7-0ubuntu7) ... Processing triggers for man-db (2.8.3-2ubuntu0.1) ... INFO: /dev/kvm exists KVM acceleration can be used Deploying KUD project Removing ppa for jonathonf/python-3.6 download_docker_com_linux_ubuntu.list google-chrome.list ppa_ansible_ansible_bionic.list ppa_deadsnakes_ppa_bionic.list ppa_openjdk_r_ppa_bionic.list puppet.list Hit:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease Hit:3 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease Hit:4 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease Get:5 https://dl.google.com/linux/chrome/deb stable InRelease [1825 B] Hit:6 https://download.docker.com/linux/ubuntu bionic InRelease Get:7 http://apt.puppetlabs.com xenial InRelease [144 kB] Hit:8 http://ppa.launchpad.net/ansible/ansible/ubuntu bionic InRelease Hit:9 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease Hit:10 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic InRelease Err:5 https://dl.google.com/linux/chrome/deb stable InRelease The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 32EE5355A6BC6E42 Err:7 http://apt.puppetlabs.com xenial InRelease The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) Reading package lists... W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://dl.google.com/linux/chrome/deb stable InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 32EE5355A6BC6E42 W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://apt.puppetlabs.com xenial InRelease: The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) W: Failed to fetch https://dl.google.com/linux/chrome/deb/dists/stable/InRelease The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 32EE5355A6BC6E42 W: Failed to fetch http://apt.puppetlabs.com/dists/xenial/InRelease The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) W: Some index files failed to download. They have been ignored, or old ones used instead. /usr/bin/gcc [INFO] Finding release for channel stable [INFO] Using v1.33.4+k3s1 as release [INFO] Downloading hash https://github.com/k3s-io/k3s/releases/download/v1.33.4+k3s1/sha256sum-amd64.txt [INFO] Downloading binary https://github.com/k3s-io/k3s/releases/download/v1.33.4+k3s1/k3s [INFO] Verifying binary download [INFO] Installing k3s to /usr/local/bin/k3s [INFO] Skipping installation of SELinux RPM [INFO] Creating /usr/local/bin/kubectl symlink to k3s [INFO] Creating /usr/local/bin/crictl symlink to k3s [INFO] Skipping /usr/local/bin/ctr symlink to k3s, command exists in PATH at /usr/bin/ctr [INFO] Creating killall script /usr/local/bin/k3s-killall.sh [INFO] Creating uninstall script /usr/local/bin/k3s-uninstall.sh [INFO] env: Creating environment file /etc/systemd/system/k3s.service.env [INFO] systemd: Creating service file /etc/systemd/system/k3s.service [INFO] systemd: Enabling k3s unit Created symlink /etc/systemd/system/multi-user.target.wants/k3s.service → /etc/systemd/system/k3s.service. [INFO] systemd: Starting k3s ● k3s.service - Lightweight Kubernetes Loaded: loaded (/etc/systemd/system/k3s.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2025-09-16 08:50:38 UTC; 11ms ago Docs: https://k3s.io Process: 4087 ExecStartPre=/sbin/modprobe overlay (code=exited, status=0/SUCCESS) Process: 4085 ExecStartPre=/sbin/modprobe br_netfilter (code=exited, status=0/SUCCESS) Main PID: 4093 (k3s-server) Tasks: 73 CGroup: /system.slice/k3s.service ├─4093 /usr/local/bin/k3s server ├─4138 containerd └─4215 /var/lib/rancher/k3s/data/9ba85800b7128afafe1105efe9e7a1dac1fbb1c762c61fb2a99971e45e157779/bin/aux/nft --check -f - No resources found in kube-system namespace. Kubernetes control plane is running at https://127.0.0.1:6443 To further debug and diagnose cluster problems, use 'kubectl cluster-info dump'. ./installer.sh: line 154: /home/jenkins/.kube/config: Permission denied Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 2074 killed; [ssh-agent] Stopped. [PostBuildScript] - [INFO] Executing post build scripts. [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins7277903358381200893.sh ---> sysstat.sh [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins13830540257087614947.sh ---> package-listing.sh ++ tr '[:upper:]' '[:lower:]' ++ facter osfamily + OS_FAMILY=debian + workspace=/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + dpkg -l + grep '^ii' + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + true + '[' /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell ']' + mkdir -p /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/archives/ [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins3526616634502214778.sh ---> capture-instance-metadata.sh Setup pyenv: * system (set by /opt/pyenv/version) * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.6 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-LEsH lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-LEsH/bin to PATH INFO: Running in OpenStack, capturing instance metadata [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins3535613615874303056.sh provisioning config files... copy managed file [jenkins-log-archives-settings] to file:/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell@tmp/config592601297905542209tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] Run condition [Regular expression match] preventing perform for step [Provide Configuration files] [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins1404084201544981376.sh ---> create-netrc.sh [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins8699787760169229840.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-LEsH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-LEsH/bin to PATH Generating Requirements File ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. httplib2 0.31.0 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. Python 3.10.6 pip 25.2 from /tmp/venv-LEsH/lib/python3.10/site-packages/pip (python 3.10) appdirs==1.4.4 argcomplete==3.6.2 aspy.yaml==1.3.0 attrs==25.3.0 autopage==0.5.2 beautifulsoup4==4.13.5 boto3==1.40.31 botocore==1.40.31 bs4==0.0.2 cachetools==5.5.2 certifi==2025.8.3 cffi==2.0.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.4.3 click==8.2.1 cliff==4.11.0 cmd2==2.7.0 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.2.1 defusedxml==0.7.1 Deprecated==1.2.18 distlib==0.4.0 dnspython==2.8.0 docker==7.1.0 dogpile.cache==1.4.1 durationpy==0.10 email-validator==2.3.0 filelock==3.19.1 future==1.0.0 gitdb==4.0.12 GitPython==3.1.45 google-auth==2.40.3 httplib2==0.31.0 identify==2.6.14 idna==3.10 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.6 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==3.0.0 jsonschema==4.25.1 jsonschema-specifications==2025.9.1 keystoneauth1==5.12.0 kubernetes==33.1.0 lftools==0.37.13 lxml==6.0.1 markdown-it-py==4.0.0 MarkupSafe==3.0.2 mdurl==0.1.2 msgpack==1.1.1 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.3.0 niet==1.4.2 nodeenv==1.9.1 oauth2client==4.1.3 oauthlib==3.3.1 openstacksdk==4.7.1 os-service-types==1.8.0 osc-lib==4.2.0 oslo.config==10.0.0 oslo.context==6.1.0 oslo.i18n==6.6.0 oslo.log==7.2.1 oslo.serialization==5.8.0 oslo.utils==9.1.0 packaging==25.0 pbr==7.0.1 platformdirs==4.4.0 prettytable==3.16.0 psutil==7.0.0 pyasn1==0.6.1 pyasn1_modules==0.4.2 pycparser==2.23 pygerrit2==2.0.15 PyGithub==2.8.1 Pygments==2.19.2 PyJWT==2.10.1 PyNaCl==1.6.0 pyparsing==2.4.7 pyperclip==1.9.0 pyrsistent==0.20.0 python-cinderclient==9.8.0 python-dateutil==2.9.0.post0 python-heatclient==4.3.0 python-jenkins==1.8.3 python-keystoneclient==5.7.0 python-magnumclient==4.9.0 python-openstackclient==8.2.0 python-swiftclient==4.8.0 PyYAML==6.0.2 referencing==0.36.2 requests==2.32.5 requests-oauthlib==2.0.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rich==14.1.0 rich-argparse==1.7.1 rpds-py==0.27.1 rsa==4.9.1 ruamel.yaml==0.18.15 ruamel.yaml.clib==0.2.12 s3transfer==0.14.0 simplejson==3.20.1 six==1.17.0 smmap==5.0.2 soupsieve==2.8 stevedore==5.5.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.13.3 tqdm==4.67.1 typing_extensions==4.15.0 tzdata==2025.2 urllib3==1.26.20 virtualenv==20.34.0 wcwidth==0.2.13 websocket-client==1.8.0 wrapt==1.17.3 xdg==6.0.0 xmltodict==1.0.0 yq==3.4.3 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins29106197796992729.sh ---> sudo-logs.sh Archiving 'sudo' log.. [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins12169285858633842743.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-LEsH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-LEsH/bin to PATH INFO: No Stack... INFO: Retrieving Pricing Info for: v3-standard-8 INFO: Archiving Costs [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash -l /tmp/jenkins14573364164232685447.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-LEsH from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) lf-activate-venv(): INFO: Attempting to install with network-safe options... lf-activate-venv(): INFO: Base packages installed successfully lf-activate-venv(): INFO: Installing additional packages: lftools lf-activate-venv(): INFO: Adding /tmp/venv-LEsH/bin to PATH INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/multicloud-k8s-master-kud-deployment-verify-shell/2122 INFO: archiving workspace using pattern(s): Archives upload complete. INFO: archiving logs to Nexus ---> uname -a: Linux prd-ubuntu1804-docker-8c-8g-46170 4.15.0-192-generic #203-Ubuntu SMP Wed Aug 10 17:40:03 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 8 On-line CPU(s) list: 0-7 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 8 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2799.998 BogoMIPS: 5599.99 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0-7 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl xtopology cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 8 ---> df -h: Filesystem Size Used Avail Use% Mounted on udev 16G 0 16G 0% /dev tmpfs 3.2G 1.6M 3.2G 1% /run /dev/vda1 155G 12G 144G 8% / tmpfs 16G 0 16G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 16G 0 16G 0% /sys/fs/cgroup /dev/vda15 105M 4.4M 100M 5% /boot/efi tmpfs 3.2G 0 3.2G 0% /run/user/1001 shm 64M 0 64M 0% /run/k3s/containerd/io.containerd.grpc.v1.cri/sandboxes/6aaae760521ffb0a7a792872680c338b4cfb3c9757fd25c727e4f0fda1d58087/shm shm 64M 0 64M 0% /run/k3s/containerd/io.containerd.grpc.v1.cri/sandboxes/e07443b49d2ea58399ae4679a6d628381781b7142d58d199f5901c97fb102300/shm shm 64M 0 64M 0% /run/k3s/containerd/io.containerd.grpc.v1.cri/sandboxes/0caa6cea7c78ce68e41ae55b9fdfc81b6b88e75940114711943b55f31050ae16/shm shm 64M 0 64M 0% /run/k3s/containerd/io.containerd.grpc.v1.cri/sandboxes/48c6a0a0ac666468f13c86333e3c545f6190dc24e3cc6ef65c5297ae8264534d/shm shm 64M 0 64M 0% /run/k3s/containerd/io.containerd.grpc.v1.cri/sandboxes/4938f11f673f24a89d2346e5410cc8a01bc712b773d44995f05a44c071942d38/shm ---> free -m: total used free shared buff/cache available Mem: 32167 1441 27186 1 3539 30272 Swap: 0 0 0 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:31:94:ad brd ff:ff:ff:ff:ff:ff inet 10.30.107.245/23 brd 10.30.107.255 scope global dynamic ens3 valid_lft 86232sec preferred_lft 86232sec inet6 fe80::f816:3eff:fe31:94ad/64 scope link valid_lft forever preferred_lft forever 3: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:39:f2:66:aa brd ff:ff:ff:ff:ff:ff inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 valid_lft forever preferred_lft forever 4: flannel.1: mtu 1408 qdisc noqueue state UNKNOWN group default link/ether 16:55:1d:9d:c9:d3 brd ff:ff:ff:ff:ff:ff inet 10.42.0.0/32 scope global flannel.1 valid_lft forever preferred_lft forever inet6 fe80::1455:1dff:fe9d:c9d3/64 scope link valid_lft forever preferred_lft forever 5: cni0: mtu 1408 qdisc noqueue state UP group default qlen 1000 link/ether 22:44:6a:54:eb:82 brd ff:ff:ff:ff:ff:ff inet 10.42.0.1/24 brd 10.42.0.255 scope global cni0 valid_lft forever preferred_lft forever inet6 fe80::2044:6aff:fe54:eb82/64 scope link valid_lft forever preferred_lft forever 8: veth66fcabe4@if2: mtu 1408 qdisc noqueue master cni0 state UP group default qlen 1000 link/ether d6:11:27:e9:00:37 brd ff:ff:ff:ff:ff:ff link-netnsid 2 inet6 fe80::d411:27ff:fee9:37/64 scope link valid_lft forever preferred_lft forever 9: veth14ebe723@if2: mtu 1408 qdisc noqueue master cni0 state UP group default qlen 1000 link/ether 56:46:c7:b7:60:e2 brd ff:ff:ff:ff:ff:ff link-netnsid 3 inet6 fe80::5446:c7ff:feb7:60e2/64 scope link valid_lft forever preferred_lft forever 10: vethde04482c@if2: mtu 1408 qdisc noqueue master cni0 state UP group default qlen 1000 link/ether 72:fb:d5:9e:62:4c brd ff:ff:ff:ff:ff:ff link-netnsid 4 inet6 fe80::70fb:d5ff:fe9e:624c/64 scope link valid_lft forever preferred_lft forever 11: veth78cf9f86@if2: mtu 1408 qdisc noqueue master cni0 state UP group default qlen 1000 link/ether 22:5c:84:9a:61:e1 brd ff:ff:ff:ff:ff:ff link-netnsid 5 inet6 fe80::205c:84ff:fe9a:61e1/64 scope link valid_lft forever preferred_lft forever 12: veth168f6725@if2: mtu 1408 qdisc noqueue master cni0 state UP group default qlen 1000 link/ether 52:70:d7:30:86:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet6 fe80::5070:d7ff:fe30:8660/64 scope link valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-46170) 09/16/25 _x86_64_ (8 CPU) 08:49:23 LINUX RESTART (8 CPU) 08:50:01 tps rtps wtps bread/s bwrtn/s 08:51:01 504.18 64.94 439.24 2315.75 82816.06 08:52:01 125.23 1.25 123.98 99.45 44824.93 Average: 314.71 33.09 281.61 1207.60 63820.50 08:50:01 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 08:51:01 28127992 30989404 4811228 14.61 67780 3082196 2450288 7.44 1982288 2452100 227520 08:52:01 27831016 30989204 5108204 15.51 92488 3337632 2497812 7.58 2002548 2694804 119808 Average: 27979504 30989304 4959716 15.06 80134 3209914 2474050 7.51 1992418 2573452 173664 08:50:01 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 08:51:01 cni0 37.83 34.44 35.03 106.81 0.00 0.00 0.75 0.00 08:51:01 veth66fcabe4 2.47 3.58 0.75 1.75 0.00 0.00 0.00 0.00 08:51:01 veth14ebe723 0.48 1.27 0.09 0.19 0.00 0.00 0.00 0.00 08:51:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 08:52:01 cni0 11.60 13.26 3.28 2.71 0.00 0.00 0.20 0.00 08:52:01 veth66fcabe4 7.20 8.77 3.05 1.97 0.00 0.00 0.00 0.00 08:52:01 veth14ebe723 0.18 0.32 0.01 0.03 0.00 0.00 0.00 0.00 08:52:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: cni0 24.71 23.85 19.15 54.76 0.00 0.00 0.47 0.00 Average: veth66fcabe4 4.83 6.17 1.90 1.86 0.00 0.00 0.00 0.00 Average: veth14ebe723 0.33 0.79 0.05 0.11 0.00 0.00 0.00 0.00 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-46170) 09/16/25 _x86_64_ (8 CPU) 08:49:23 LINUX RESTART (8 CPU) 08:50:01 CPU %user %nice %system %iowait %steal %idle 08:51:01 all 13.49 0.75 3.60 2.61 0.07 79.48 08:51:01 0 18.79 0.02 4.07 2.24 0.07 74.82 08:51:01 1 10.29 0.00 3.15 1.63 0.05 84.88 08:51:01 2 13.24 0.00 4.46 4.45 0.07 77.78 08:51:01 3 11.71 0.00 3.50 0.87 0.08 83.83 08:51:01 4 10.61 1.75 3.74 4.60 0.07 79.24 08:51:01 5 11.15 0.00 3.19 4.47 0.08 81.10 08:51:01 6 16.14 0.00 3.39 1.41 0.07 78.99 08:51:01 7 16.02 4.22 3.23 1.26 0.07 75.20 08:52:01 all 10.55 0.00 1.04 1.16 0.06 87.19 08:52:01 0 7.47 0.00 0.92 0.25 0.03 91.33 08:52:01 1 4.97 0.00 0.80 0.40 0.05 93.78 08:52:01 2 7.98 0.00 1.18 2.29 0.07 88.48 08:52:01 3 25.93 0.00 1.25 0.47 0.07 72.28 08:52:01 4 6.83 0.00 0.70 0.34 0.07 92.06 08:52:01 5 23.30 0.00 2.14 1.54 0.08 72.93 08:52:01 6 3.25 0.00 0.67 0.42 0.03 95.63 08:52:01 7 4.70 0.00 0.69 3.55 0.05 91.02 Average: all 12.02 0.37 2.32 1.88 0.06 83.34 Average: 0 13.12 0.01 2.49 1.25 0.05 83.08 Average: 1 7.63 0.00 1.98 1.01 0.05 89.33 Average: 2 10.60 0.00 2.82 3.36 0.07 83.15 Average: 3 18.84 0.00 2.37 0.67 0.08 78.04 Average: 4 8.72 0.87 2.22 2.46 0.07 85.66 Average: 5 17.24 0.00 2.67 3.00 0.08 77.01 Average: 6 9.68 0.00 2.02 0.91 0.05 87.33 Average: 7 10.35 2.11 1.96 2.40 0.06 83.12