09:04:27 Triggered by Gerrit: https://gerrit.onap.org/r/c/multicloud/k8s/+/145779 09:04:27 Running as SYSTEM 09:04:27 [EnvInject] - Loading node environment variables. 09:04:27 Building remotely on prd-ubuntu1804-docker-8c-8g-4803 (ubuntu1804-docker-8c-8g) in workspace /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell 09:04:27 [ssh-agent] Looking for ssh-agent implementation... 09:04:27 $ ssh-agent 09:04:27 SSH_AUTH_SOCK=/tmp/ssh-UPERSD62zMzy/agent.1996 09:04:27 SSH_AGENT_PID=1998 09:04:27 [ssh-agent] Started. 09:04:27 Running ssh-add (command line suppressed) 09:04:27 Identity added: /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell@tmp/private_key_10901286174597049802.key (/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell@tmp/private_key_10901286174597049802.key) 09:04:28 [ssh-agent] Using credentials onap-jobbuiler (Gerrit user) 09:04:28 The recommended git tool is: NONE 09:04:29 using credential onap-jenkins-ssh 09:04:29 Wiping out workspace first. 09:04:29 Cloning the remote Git repository 09:04:29 Cloning repository git://cloud.onap.org/mirror/multicloud/k8s.git 09:04:29 > git init /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell # timeout=10 09:04:29 Fetching upstream changes from git://cloud.onap.org/mirror/multicloud/k8s.git 09:04:29 > git --version # timeout=10 09:04:29 > git --version # 'git version 2.17.1' 09:04:29 using GIT_SSH to set credentials Gerrit user 09:04:29 Verifying host key using manually-configured host key entries 09:04:29 > git fetch --tags --progress -- git://cloud.onap.org/mirror/multicloud/k8s.git +refs/heads/*:refs/remotes/origin/* # timeout=30 09:04:30 > git config remote.origin.url git://cloud.onap.org/mirror/multicloud/k8s.git # timeout=10 09:04:30 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 09:04:30 > git config remote.origin.url git://cloud.onap.org/mirror/multicloud/k8s.git # timeout=10 09:04:30 Fetching upstream changes from git://cloud.onap.org/mirror/multicloud/k8s.git 09:04:30 using GIT_SSH to set credentials Gerrit user 09:04:30 Verifying host key using manually-configured host key entries 09:04:30 > git fetch --tags --progress -- git://cloud.onap.org/mirror/multicloud/k8s.git refs/changes/79/145779/4 # timeout=30 09:04:30 > git rev-parse 7ce6a8420983f36bb2c26deedea5869068ef50e6^{commit} # timeout=10 09:04:30 JENKINS-19022: warning: possible memory leak due to Git plugin usage; see: https://plugins.jenkins.io/git/#remove-git-plugin-buildsbybranch-builddata-script 09:04:30 Checking out Revision 7ce6a8420983f36bb2c26deedea5869068ef50e6 (refs/changes/79/145779/4) 09:04:30 > git config core.sparsecheckout # timeout=10 09:04:30 > git checkout -f 7ce6a8420983f36bb2c26deedea5869068ef50e6 # timeout=30 09:04:34 Commit message: "Fix: Stabilize k3s API server in KUD deployment gate" 09:04:34 > git rev-parse FETCH_HEAD^{commit} # timeout=10 09:04:34 > git rev-list --no-walk 5c3b1a96811024e65b0977305b6d6737a6e2d453 # timeout=10 09:04:34 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins176080818062221127.sh 09:04:34 + cd ./kud/ci 09:04:34 + bash -x ./kud-installer.sh 09:04:34 + set -x -e -o pipefail 09:04:34 +++ dirname ./kud-installer.sh 09:04:34 ++ readlink -f . 09:04:34 + curr_dir=/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/kud/ci 09:04:34 + cd /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/kud/ci/../hosting_providers/baremetal 09:04:34 + export 'KUD_ADDONS=virtlet ovn4nfv' 09:04:34 + KUD_ADDONS='virtlet ovn4nfv' 09:04:34 + ./aio.sh 09:04:34 Preparing inventory for ansible 09:04:34 Allowing present ~/.ssh/id_rsa key to be used for login to this host 09:04:34 Enabling nested-virtualization 09:04:34 Get:1 https://download.docker.com/linux/ubuntu bionic InRelease [64.4 kB] 09:04:34 Get:2 https://download.docker.com/linux/ubuntu bionic/stable amd64 Packages [39.0 kB] 09:04:34 Get:3 http://security.ubuntu.com/ubuntu bionic-security InRelease [102 kB] 09:04:35 Get:4 http://apt.puppetlabs.com xenial InRelease [144 kB] 09:04:35 Get:5 https://dl.google.com/linux/chrome/deb stable InRelease [1825 B] 09:04:35 Hit:6 http://ppa.launchpad.net/ansible/ansible/ubuntu bionic InRelease 09:04:35 Get:7 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease [242 kB] 09:04:35 Err:4 http://apt.puppetlabs.com xenial InRelease 09:04:35 The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) 09:04:35 Get:8 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease [15.9 kB] 09:04:35 Get:9 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease [102 kB] 09:04:35 Get:10 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease [102 kB] 09:04:35 Err:5 https://dl.google.com/linux/chrome/deb stable InRelease 09:04:35 The following signatures couldn't be verified because the public key is not available: NO_PUBKEY FD533C07C264648F 09:04:35 Get:11 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic InRelease [21.5 kB] 09:04:35 Get:12 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 Packages [1019 kB] 09:04:35 Get:13 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main Translation-en [516 kB] 09:04:35 Get:14 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/restricted amd64 Packages [9184 B] 09:04:35 Get:15 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/restricted Translation-en [3584 B] 09:04:35 Get:16 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/universe amd64 Packages [8570 kB] 09:04:35 Get:17 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/universe Translation-en [4941 kB] 09:04:35 Get:18 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/multiverse amd64 Packages [151 kB] 09:04:35 Get:19 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/multiverse Translation-en [108 kB] 09:04:35 Get:20 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [3092 kB] 09:04:35 Get:21 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [552 kB] 09:04:35 Get:22 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [1368 kB] 09:04:35 Get:23 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [187 kB] 09:04:35 Get:24 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1936 kB] 09:04:35 Get:25 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [420 kB] 09:04:35 Get:26 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [25.7 kB] 09:04:35 Get:27 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [6056 B] 09:04:35 Get:28 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/main amd64 Packages [53.7 kB] 09:04:35 Get:29 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/main Translation-en [14.5 kB] 09:04:35 Get:30 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/universe amd64 Packages [18.3 kB] 09:04:35 Get:31 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports/universe Translation-en [8612 B] 09:04:36 Get:32 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main amd64 Packages [524 B] 09:04:36 Get:33 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [2762 kB] 09:04:36 Get:34 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [467 kB] 09:04:36 Get:35 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [1338 kB] 09:04:36 Get:36 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [182 kB] 09:04:36 Get:37 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1319 kB] 09:04:36 Get:38 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic/main Translation-en [416 B] 09:04:36 Get:39 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [307 kB] 09:04:36 Get:40 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [19.8 kB] 09:04:36 Get:41 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [3896 B] 09:04:36 Get:42 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic/main amd64 Packages [14.0 kB] 09:04:36 Get:43 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic/main Translation-en [1008 B] 09:04:42 Fetched 30.2 MB in 5s (5863 kB/s) 09:04:42 Reading package lists... 09:04:43 W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://apt.puppetlabs.com xenial InRelease: The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) 09:04:43 W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://dl.google.com/linux/chrome/deb stable InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY FD533C07C264648F 09:04:43 W: Failed to fetch https://dl.google.com/linux/chrome/deb/dists/stable/InRelease The following signatures couldn't be verified because the public key is not available: NO_PUBKEY FD533C07C264648F 09:04:43 W: Failed to fetch http://apt.puppetlabs.com/dists/xenial/InRelease The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) 09:04:43 W: Some index files failed to download. They have been ignored, or old ones used instead. 09:04:43 Reading package lists... 09:04:43 Building dependency tree... 09:04:44 Reading state information... 09:04:44 The following packages were automatically installed and are no longer required: 09:04:44 libmysqlclient20 mysql-common 09:04:44 Use 'sudo apt autoremove' to remove them. 09:04:44 The following additional packages will be installed: 09:04:44 msr-tools 09:04:44 The following NEW packages will be installed: 09:04:44 cpu-checker msr-tools 09:04:44 0 upgraded, 2 newly installed, 0 to remove and 207 not upgraded. 09:04:44 Need to get 16.6 kB of archives. 09:04:44 After this operation, 62.5 kB of additional disk space will be used. 09:04:44 Get:1 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 msr-tools amd64 1.3-2build1 [9760 B] 09:04:44 Get:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic/main amd64 cpu-checker amd64 0.7-0ubuntu7 [6862 B] 09:04:45 debconf: unable to initialize frontend: Dialog 09:04:45 debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 09:04:45 debconf: falling back to frontend: Readline 09:04:45 debconf: unable to initialize frontend: Readline 09:04:45 debconf: (This frontend requires a controlling tty.) 09:04:45 debconf: falling back to frontend: Teletype 09:04:45 dpkg-preconfigure: unable to re-open stdin: 09:04:45 Fetched 16.6 kB in 0s (42.1 kB/s) 09:04:45 Selecting previously unselected package msr-tools. 09:04:45 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 203834 files and directories currently installed.) 09:04:45 Preparing to unpack .../msr-tools_1.3-2build1_amd64.deb ... 09:04:45 Unpacking msr-tools (1.3-2build1) ... 09:04:45 Selecting previously unselected package cpu-checker. 09:04:45 Preparing to unpack .../cpu-checker_0.7-0ubuntu7_amd64.deb ... 09:04:45 Unpacking cpu-checker (0.7-0ubuntu7) ... 09:04:45 Setting up msr-tools (1.3-2build1) ... 09:04:46 Setting up cpu-checker (0.7-0ubuntu7) ... 09:04:46 Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 09:04:47 INFO: /dev/kvm exists 09:04:47 KVM acceleration can be used 09:04:48 Deploying KUD project 09:04:48 Removing ppa for jonathonf/python-3.6 09:04:48 download_docker_com_linux_ubuntu.list 09:04:48 google-chrome.list 09:04:48 ppa_ansible_ansible_bionic.list 09:04:48 ppa_deadsnakes_ppa_bionic.list 09:04:48 ppa_openjdk_r_ppa_bionic.list 09:04:48 puppet.list 09:04:48 Hit:1 https://download.docker.com/linux/ubuntu bionic InRelease 09:04:48 Hit:2 http://nova.clouds.archive.ubuntu.com/ubuntu bionic InRelease 09:04:48 Get:3 https://dl.google.com/linux/chrome/deb stable InRelease [1825 B] 09:04:48 Get:4 http://apt.puppetlabs.com xenial InRelease [144 kB] 09:04:48 Hit:5 http://ppa.launchpad.net/ansible/ansible/ubuntu bionic InRelease 09:04:48 Hit:6 http://security.ubuntu.com/ubuntu bionic-security InRelease 09:04:48 Hit:7 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-updates InRelease 09:04:48 Hit:8 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease 09:04:48 Hit:9 http://nova.clouds.archive.ubuntu.com/ubuntu bionic-backports InRelease 09:04:48 Hit:10 http://ppa.launchpad.net/openjdk-r/ppa/ubuntu bionic InRelease 09:04:48 Err:3 https://dl.google.com/linux/chrome/deb stable InRelease 09:04:48 The following signatures couldn't be verified because the public key is not available: NO_PUBKEY FD533C07C264648F 09:04:48 Err:4 http://apt.puppetlabs.com xenial InRelease 09:04:48 The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) 09:04:50 Reading package lists... 09:04:51 W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: https://dl.google.com/linux/chrome/deb stable InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY FD533C07C264648F 09:04:51 W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://apt.puppetlabs.com xenial InRelease: The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) 09:04:51 W: Failed to fetch https://dl.google.com/linux/chrome/deb/dists/stable/InRelease The following signatures couldn't be verified because the public key is not available: NO_PUBKEY FD533C07C264648F 09:04:51 W: Failed to fetch http://apt.puppetlabs.com/dists/xenial/InRelease The following signatures were invalid: EXPKEYSIG 4528B6CD9E61EF26 Puppet, Inc. Release Key (Puppet, Inc. Release Key) 09:04:51 W: Some index files failed to download. They have been ignored, or old ones used instead. 09:04:51 /usr/bin/gcc 09:04:51 Installing k3s... 09:04:52 [INFO] Finding release for channel stable 09:04:53 [INFO] Using v1.36.2+k3s1 as release 09:04:53 [INFO] Downloading hash https://github.com/k3s-io/k3s/releases/download/v1.36.2%2Bk3s1/sha256sum-amd64.txt 09:04:53 [INFO] Downloading binary https://github.com/k3s-io/k3s/releases/download/v1.36.2%2Bk3s1/k3s 09:04:53 [INFO] Verifying binary download 09:04:54 [INFO] Installing k3s to /usr/local/bin/k3s 09:04:54 [INFO] Skipping installation of SELinux RPM 09:04:54 [INFO] Creating /usr/local/bin/kubectl symlink to k3s 09:04:54 [INFO] Creating /usr/local/bin/crictl symlink to k3s 09:04:54 [INFO] Skipping /usr/local/bin/ctr symlink to k3s, command exists in PATH at /usr/bin/ctr 09:04:54 [INFO] Creating killall script /usr/local/bin/k3s-killall.sh 09:04:54 [INFO] Creating uninstall script /usr/local/bin/k3s-uninstall.sh 09:04:54 [INFO] env: Creating environment file /etc/systemd/system/k3s.service.env 09:04:54 [INFO] systemd: Creating service file /etc/systemd/system/k3s.service 09:04:54 [INFO] systemd: Enabling k3s unit 09:04:54 Created symlink /etc/systemd/system/multi-user.target.wants/k3s.service → /etc/systemd/system/k3s.service. 09:04:55 [INFO] systemd: Starting k3s 09:05:03 ● k3s.service - Lightweight Kubernetes 09:05:03 Loaded: loaded (/etc/systemd/system/k3s.service; enabled; vendor preset: enabled) 09:05:03 Active: active (running) since Fri 2026-07-03 09:05:03 UTC; 15ms ago 09:05:03 Docs: https://k3s.io 09:05:03 Process: 4017 ExecStartPre=/sbin/modprobe overlay (code=exited, status=0/SUCCESS) 09:05:03 Process: 4015 ExecStartPre=/sbin/modprobe br_netfilter (code=exited, status=0/SUCCESS) 09:05:03 Main PID: 4023 (k3s-server) 09:05:03 Tasks: 32 09:05:03 CGroup: /system.slice/k3s.service 09:05:03 ├─4023 /usr/local/bin/k3s server 09:05:03 ├─4068 containerd 09:05:03 └─4112 /var/lib/rancher/k3s/data/25bd5c205b3a990305155ad3b8e899582026d2d802b257105310b41a262941c1/bin/aux/nft --check -f - 09:05:03 Waiting for k3s API server to become ready... 09:08:07 ERROR: k3s API server did not become ready within 180s 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214210 6217 shared_informer.go:388] "Caches are synced" controller="crd-autoregister" 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:01Z" level=info msg="Caches are synced" logger=k3s 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214255 6217 cache.go:39] Caches are synced for LocalAvailability controller 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214279 6217 aggregator.go:187] initial CRD sync complete... 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214294 6217 autoregister_controller.go:144] Starting autoregister controller 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214303 6217 cache.go:32] Waiting for caches to sync for autoregister controller 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214312 6217 cache.go:39] Caches are synced for autoregister controller 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.214631 6217 shared_informer.go:388] "Caches are synced" controller="ipallocator-repair-controller" 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:01Z" level=info msg="Caches are synced" logger=k3s 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.223448 6217 handler_discovery.go:459] Starting ResourceDiscoveryManager 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: E0703 09:08:01.227505 6217 controller.go:102] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:01.240667 6217 controller.go:667] quota admission added evaluator for: leases.coordination.k8s.io 09:08:07 Jul 03 09:08:01 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:01Z" level=info msg="containerd is now running" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Running kubelet --cloud-provider=external --config-dir=/var/lib/rancher/k3s/agent/etc/kubelet.conf.d --containerd=/run/k3s/containerd/containerd.sock --hostname-override=prd-ubuntu1804-docker-8c-8g-4803 --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-ip=10.30.106.63 --node-labels= --read-only-port=0" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:02.118477 6217 storage_scheduling.go:153] all system priority classes are created successfully or already exist. 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Kube API server is now running" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="k3s is up and running" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Waiting for untainted node" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 systemd[1]: Started Lightweight Kubernetes. 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Event occurred" apiVersion= fieldPath= kind=Node logger=k3s message="Node and Certificate Authority certificates managed by k3s are OK" object=prd-ubuntu1804-docker-8c-8g-4803 reason=CertificateExpirationOK type=Normal 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Creating k3s-supervisor event broadcaster" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: Error: failed to validate kubelet configuration, error: kubelet is configured to not run on a host using cgroup v1. cgroup v1 support is unsupported and will be removed in a future release, path: &TypeMeta{Kind:,APIVersion:,} 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=error msg="Shutdown request received: \"kubelet exited: failed to validate kubelet configuration, error: kubelet is configured to not run on a host using cgroup v1. cgroup v1 support is unsupported and will be removed in a future release, path: &TypeMeta{Kind:,APIVersion:,}\"" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Waiting up to 2s for graceful shutdown of Kine GRPC server..." 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=warning msg="unable to list existing CRDs: failed to list crds: context canceled" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Creating embedded CRD addons.k3s.cattle.io" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-40.1.3+up40.1.0.tgz" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-40.1.3+up40.1.0.tgz" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/runtimes.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=error msg="Failed to migrate node-password secrets: context canceled" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Starting dynamiclistener CN filter node controller with SANs: [127.0.0.1 ::1 localhost prd-ubuntu1804-docker-8c-8g-4803 10.30.106.63 10.43.0.1 kubernetes kubernetes.default kubernetes.default.svc kubernetes.default.svc.cluster.local]" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:02Z" level=info msg="Tunnel server egress proxy mode: agent" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: E0703 09:08:02.585209 6217 reflector.go:227] "Failed to watch" err="failed to list *v1.Addon: the server could not find the requested resource (get addons.meta.k8s.io)" logger="UnhandledError" reflector="k8s.io/client-go@v1.36.2-k3s1/tools/cache/reflector.go:343" type="*v1.Addon" 09:08:07 Jul 03 09:08:02 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: I0703 09:08:02.694186 6217 shared_informer.go:402] "Waiting for caches to sync" 09:08:07 Jul 03 09:08:03 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: E0703 09:08:03.702137 6217 reflector.go:227] "Failed to watch" err="failed to list *v1.Addon: the server could not find the requested resource (get addons.meta.k8s.io)" logger="UnhandledError" reflector="k8s.io/client-go@v1.36.2-k3s1/tools/cache/reflector.go:343" type="*v1.Addon" 09:08:07 Jul 03 09:08:04 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:04Z" level=info msg="Closing database connections..." 09:08:07 Jul 03 09:08:04 prd-ubuntu1804-docker-8c-8g-4803 k3s[6217]: time="2026-07-03T09:08:04Z" level=info msg="TTL events work queue has shut down" 09:08:07 Build step 'Execute shell' marked build as failure 09:08:07 $ ssh-agent -k 09:08:07 unset SSH_AUTH_SOCK; 09:08:07 unset SSH_AGENT_PID; 09:08:07 echo Agent pid 1998 killed; 09:08:07 [ssh-agent] Stopped. 09:08:07 [PostBuildScript] - [INFO] Executing post build scripts. 09:08:07 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins5375495384404773212.sh 09:08:07 ---> sysstat.sh 09:08:08 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins9394290211790475805.sh 09:08:08 ---> package-listing.sh 09:08:08 ++ facter osfamily 09:08:08 ++ tr '[:upper:]' '[:lower:]' 09:08:08 + OS_FAMILY=debian 09:08:08 + workspace=/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell 09:08:08 + START_PACKAGES=/tmp/packages_start.txt 09:08:08 + END_PACKAGES=/tmp/packages_end.txt 09:08:08 + DIFF_PACKAGES=/tmp/packages_diff.txt 09:08:08 + PACKAGES=/tmp/packages_start.txt 09:08:08 + '[' /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell ']' 09:08:08 + PACKAGES=/tmp/packages_end.txt 09:08:08 + case "${OS_FAMILY}" in 09:08:08 + dpkg -l 09:08:08 + grep '^ii' 09:08:08 + '[' -f /tmp/packages_start.txt ']' 09:08:08 + '[' -f /tmp/packages_end.txt ']' 09:08:08 + diff /tmp/packages_start.txt /tmp/packages_end.txt 09:08:08 + true 09:08:08 + '[' /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell ']' 09:08:08 + mkdir -p /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/archives/ 09:08:08 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/archives/ 09:08:08 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins5313674381970157093.sh 09:08:08 ---> capture-instance-metadata.sh 09:08:08 Setup pyenv: 09:08:08 * system (set by /opt/pyenv/version) 09:08:08 * 3.8.13 (set by /opt/pyenv/version) 09:08:08 * 3.9.13 (set by /opt/pyenv/version) 09:08:08 * 3.10.6 (set by /opt/pyenv/version) 09:08:12 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-Mwla 09:08:12 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 09:08:12 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:08:12 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:08:16 lf-activate-venv(): INFO: Base packages installed successfully 09:08:16 lf-activate-venv(): INFO: Installing additional packages: lftools 09:08:39 lf-activate-venv(): INFO: Adding /tmp/venv-Mwla/bin to PATH 09:08:39 INFO: Running in OpenStack, capturing instance metadata 09:08:39 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins8565001851500683054.sh 09:08:39 provisioning config files... 09:08:39 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/multicloud-k8s-master-kud-deployment-verify-shell@tmp/config11934281172951701444tmp 09:08:39 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 09:08:39 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 09:08:39 [EnvInject] - Injecting environment variables from a build step. 09:08:39 [EnvInject] - Injecting as environment variables the properties content 09:08:39 SERVER_ID=logs 09:08:39 09:08:39 [EnvInject] - Variables injected successfully. 09:08:39 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins8182720492379279958.sh 09:08:39 ---> create-netrc.sh 09:08:39 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins15141888789310215523.sh 09:08:39 ---> python-tools-install.sh 09:08:39 Setup pyenv: 09:08:39 system 09:08:39 3.8.13 09:08:39 3.9.13 09:08:39 * 3.10.6 (set by /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/.python-version) 09:08:39 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mwla from file:/tmp/.os_lf_venv 09:08:39 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:08:39 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:08:41 lf-activate-venv(): INFO: Base packages installed successfully 09:08:41 lf-activate-venv(): INFO: Installing additional packages: lftools 09:08:49 lf-activate-venv(): INFO: Adding /tmp/venv-Mwla/bin to PATH 09:08:49 Generating Requirements File 09:09:11 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 09:09:11 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 09:09:11 Python 3.10.6 09:09:11 pip 26.1.2 from /tmp/venv-Mwla/lib/python3.10/site-packages/pip (python 3.10) 09:09:12 aiohappyeyeballs==2.7.1 09:09:12 aiohttp==3.14.1 09:09:12 aiosignal==1.4.0 09:09:12 appdirs==1.4.4 09:09:12 argcomplete==3.7.0 09:09:12 aspy.yaml==1.3.0 09:09:12 async-timeout==5.0.1 09:09:12 attrs==26.1.0 09:09:12 autopage==0.6.0 09:09:12 backports.strenum==1.3.1 09:09:12 beautifulsoup4==4.15.0 09:09:12 boto3==1.43.40 09:09:12 botocore==1.43.40 09:09:12 bs4==0.0.2 09:09:12 certifi==2026.6.17 09:09:12 cffi==2.0.0 09:09:12 cfgv==3.5.0 09:09:12 chardet==7.4.3 09:09:12 charset-normalizer==3.4.7 09:09:12 click==8.4.2 09:09:12 cliff==4.14.0 09:09:12 cmd2==3.5.1 09:09:12 cryptography==3.3.2 09:09:12 debtcollector==3.1.0 09:09:12 decorator==5.3.1 09:09:12 defusedxml==0.7.1 09:09:12 Deprecated==1.3.1 09:09:12 distlib==0.4.3 09:09:12 dnspython==2.8.0 09:09:12 docker==7.1.0 09:09:12 dogpile.cache==1.5.0 09:09:12 durationpy==0.10 09:09:12 email-validator==2.3.0 09:09:12 filelock==3.29.5 09:09:12 frozenlist==1.8.0 09:09:12 future==1.0.0 09:09:12 gitdb==4.0.12 09:09:12 GitPython==3.1.50 09:09:12 httplib2==0.30.2 09:09:12 identify==2.6.19 09:09:12 idna==3.18 09:09:12 importlib-resources==1.5.0 09:09:12 iso8601==2.1.0 09:09:12 Jinja2==3.1.6 09:09:12 jmespath==1.1.0 09:09:12 jsonpatch==1.33 09:09:12 jsonpointer==3.1.1 09:09:12 jsonschema==4.26.0 09:09:12 jsonschema-specifications==2025.9.1 09:09:12 keystoneauth1==5.14.0 09:09:12 kubernetes==36.0.2 09:09:12 lftools==0.37.22 09:09:12 lxml==6.1.1 09:09:12 markdown-it-py==4.2.0 09:09:12 MarkupSafe==3.0.3 09:09:12 mdurl==0.1.2 09:09:12 msgpack==1.2.1 09:09:12 multi_key_dict==2.0.3 09:09:12 multidict==6.7.1 09:09:12 munch==4.0.0 09:09:12 netaddr==1.3.0 09:09:12 niet==1.4.2 09:09:12 nodeenv==1.10.0 09:09:12 oauth2client==4.1.3 09:09:12 oauthlib==3.3.1 09:09:12 openstacksdk==4.13.0 09:09:12 os-service-types==1.8.2 09:09:12 osc-lib==4.6.0 09:09:12 oslo.config==10.4.0 09:09:12 oslo.context==6.4.0 09:09:12 oslo.i18n==6.8.0 09:09:12 oslo.log==8.2.0 09:09:12 oslo.serialization==5.10.0 09:09:12 oslo.utils==10.1.1 09:09:12 packaging==26.2 09:09:12 pbr==7.0.3 09:09:12 platformdirs==4.10.0 09:09:12 prettytable==3.18.0 09:09:12 propcache==0.5.2 09:09:12 psutil==7.2.2 09:09:12 pyasn1==0.6.3 09:09:12 pyasn1_modules==0.4.2 09:09:12 pycparser==3.0 09:09:12 pygerrit2==2.0.15 09:09:12 PyGithub==2.9.1 09:09:12 Pygments==2.20.0 09:09:12 PyJWT==2.13.0 09:09:12 PyNaCl==1.6.2 09:09:12 pyparsing==2.4.7 09:09:12 pyperclip==1.11.0 09:09:12 pyrsistent==0.20.0 09:09:12 python-cinderclient==9.9.0 09:09:12 python-dateutil==2.9.0.post0 09:09:12 python-discovery==1.4.2 09:09:12 python-heatclient==5.2.0 09:09:12 python-jenkins==1.8.3 09:09:12 python-keystoneclient==5.8.0 09:09:12 python-magnumclient==4.10.0 09:09:12 python-openstackclient==10.0.0 09:09:12 python-swiftclient==4.10.0 09:09:12 PyYAML==6.0.3 09:09:12 referencing==0.37.0 09:09:12 requests==2.34.2 09:09:12 requests-oauthlib==2.0.0 09:09:12 rfc3986==2.0.0 09:09:12 rich==15.0.0 09:09:12 rich-argparse==1.8.0 09:09:12 rpds-py==0.30.0 09:09:12 rsa==4.9.1 09:09:12 ruamel.yaml==0.19.1 09:09:12 ruamel.yaml.clib==0.2.15 09:09:12 s3transfer==0.19.0 09:09:12 simplejson==4.1.1 09:09:12 six==1.17.0 09:09:12 smmap==5.0.3 09:09:12 soupsieve==2.8.4 09:09:12 stevedore==5.8.0 09:09:12 tabulate==0.10.0 09:09:12 toml==0.10.2 09:09:12 tomlkit==0.15.0 09:09:12 tqdm==4.68.3 09:09:12 typing_extensions==4.16.0 09:09:12 urllib3==1.26.20 09:09:12 virtualenv==21.5.1 09:09:12 wcwidth==0.8.2 09:09:12 websocket-client==1.9.0 09:09:12 wrapt==2.2.2 09:09:12 xdg==6.0.0 09:09:12 xmltodict==1.0.4 09:09:12 yarl==1.24.2 09:09:12 yq==4.0.0 09:09:12 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/sh /tmp/jenkins8706594804894208728.sh 09:09:12 ---> uv-install.sh 09:09:12 Installing uv/uvx (latest) using shell installer 09:09:12 2026-07-03 09:09:12 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71233/71233] -> "/tmp/uv-install-J74Qt8.sh" [1] 09:09:12 downloading uv 0.11.26 x86_64-unknown-linux-gnu 09:09:13 installing to /home/jenkins/.local/bin 09:09:13 uv 09:09:13 uvx 09:09:13 everything's installed! 09:09:13 09:09:13 To add $HOME/.local/bin to your PATH, either restart your shell or run: 09:09:13 09:09:13 source $HOME/.local/bin/env (sh, bash, zsh) 09:09:13 source $HOME/.local/bin/env.fish (fish) 09:09:13 Adding install location to PATH 09:09:13 ---> Validating uv/uvx install 09:09:13 uvx 0.11.26 (x86_64-unknown-linux-gnu) 09:09:13 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins10698962385587130675.sh 09:09:13 ---> sudo-logs.sh 09:09:13 Archiving 'sudo' log.. 09:09:13 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash /tmp/jenkins18360578091774601999.sh 09:09:13 ---> job-cost.sh 09:09:13 INFO: Activating Python virtual environment... 09:09:13 Setup pyenv: 09:09:13 system 09:09:13 3.8.13 09:09:13 3.9.13 09:09:14 * 3.10.6 (set by /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/.python-version) 09:09:14 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mwla from file:/tmp/.os_lf_venv 09:09:14 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:09:14 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:09:15 lf-activate-venv(): INFO: Base packages installed successfully 09:09:15 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 09:09:21 lf-activate-venv(): INFO: Adding /tmp/venv-Mwla/bin to PATH 09:09:21 INFO: No stack-cost file found 09:09:21 INFO: Instance uptime: 330s 09:09:21 INFO: Fetching instance metadata (attempt 1 of 3)... 09:09:21 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 09:09:21 INFO: Successfully fetched instance metadata 09:09:21 INFO: Instance type: v3-standard-8 09:09:21 INFO: Retrieving pricing info for: v3-standard-8 09:09:21 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 09:09:21 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-standard-8/cost?seconds=330 09:09:21 INFO: Successfully fetched Vexxhost pricing API 09:09:21 INFO: Retrieved cost: 0.22 09:09:21 INFO: Retrieved resource: v3-standard-8 09:09:21 INFO: Creating archive directory: /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/archives/cost 09:09:21 INFO: Archiving costs to: /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/archives/cost.csv 09:09:21 INFO: Successfully archived job cost data 09:09:21 DEBUG: Cost data: multicloud-k8s-master-kud-deployment-verify-shell,2311,2026-07-03 09:09:21,v3-standard-8,330,0.22,0.00,FAILURE 09:09:21 [multicloud-k8s-master-kud-deployment-verify-shell] $ /bin/bash -l /tmp/jenkins10412912042245575256.sh 09:09:21 ---> logs-deploy.sh 09:09:21 Setup pyenv: 09:09:21 system 09:09:22 3.8.13 09:09:22 3.9.13 09:09:22 * 3.10.6 (set by /w/workspace/multicloud-k8s-master-kud-deployment-verify-shell/.python-version) 09:09:22 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-Mwla from file:/tmp/.os_lf_venv 09:09:22 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 09:09:22 lf-activate-venv(): INFO: Attempting to install with network-safe options... 09:09:23 lf-activate-venv(): INFO: Base packages installed successfully 09:09:23 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 09:09:31 lf-activate-venv(): INFO: Adding /tmp/venv-Mwla/bin to PATH 09:09:31 INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/multicloud-k8s-master-kud-deployment-verify-shell/2311 09:09:31 INFO: archiving workspace using pattern(s): 09:09:32 Archives upload complete. 09:09:32 INFO: archiving logs to Nexus 09:09:33 ---> uname -a: 09:09:33 Linux prd-ubuntu1804-docker-8c-8g-4803 4.15.0-192-generic #203-Ubuntu SMP Wed Aug 10 17:40:03 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux 09:09:33 09:09:33 09:09:33 ---> lscpu: 09:09:33 Architecture: x86_64 09:09:33 CPU op-mode(s): 32-bit, 64-bit 09:09:33 Byte Order: Little Endian 09:09:33 CPU(s): 8 09:09:33 On-line CPU(s) list: 0-7 09:09:33 Thread(s) per core: 1 09:09:33 Core(s) per socket: 1 09:09:33 Socket(s): 8 09:09:33 NUMA node(s): 1 09:09:33 Vendor ID: AuthenticAMD 09:09:33 CPU family: 23 09:09:33 Model: 49 09:09:33 Model name: AMD EPYC-Rome Processor 09:09:33 Stepping: 0 09:09:33 CPU MHz: 2799.998 09:09:33 BogoMIPS: 5599.99 09:09:33 Virtualization: AMD-V 09:09:33 Hypervisor vendor: KVM 09:09:33 Virtualization type: full 09:09:33 L1d cache: 32K 09:09:33 L1i cache: 32K 09:09:33 L2 cache: 512K 09:09:33 L3 cache: 16384K 09:09:33 NUMA node0 CPU(s): 0-7 09:09:33 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl xtopology cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr arat npt nrip_save umip rdpid arch_capabilities 09:09:33 09:09:33 09:09:33 ---> nproc: 09:09:33 8 09:09:33 09:09:33 09:09:33 ---> df -h: 09:09:33 Filesystem Size Used Avail Use% Mounted on 09:09:33 udev 16G 0 16G 0% /dev 09:09:33 tmpfs 3.2G 736K 3.2G 1% /run 09:09:33 /dev/vda1 155G 11G 145G 7% / 09:09:33 tmpfs 16G 0 16G 0% /dev/shm 09:09:33 tmpfs 5.0M 0 5.0M 0% /run/lock 09:09:33 tmpfs 16G 0 16G 0% /sys/fs/cgroup 09:09:33 /dev/vda15 105M 4.4M 100M 5% /boot/efi 09:09:33 tmpfs 3.2G 0 3.2G 0% /run/user/1001 09:09:33 09:09:33 09:09:33 ---> free -m: 09:09:33 total used free shared buff/cache available 09:09:33 Mem: 32167 1064 28275 0 2826 30665 09:09:33 Swap: 0 0 0 09:09:33 09:09:33 09:09:33 ---> ip addr: 09:09:33 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 09:09:33 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 09:09:33 inet 127.0.0.1/8 scope host lo 09:09:33 valid_lft forever preferred_lft forever 09:09:33 inet6 ::1/128 scope host 09:09:33 valid_lft forever preferred_lft forever 09:09:33 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 09:09:33 link/ether fa:16:3e:b9:09:9d brd ff:ff:ff:ff:ff:ff 09:09:33 inet 10.30.106.63/23 brd 10.30.107.255 scope global dynamic ens3 09:09:33 valid_lft 86066sec preferred_lft 86066sec 09:09:33 inet6 fe80::f816:3eff:feb9:99d/64 scope link 09:09:33 valid_lft forever preferred_lft forever 09:09:33 3: docker0: mtu 1500 qdisc noqueue state DOWN group default 09:09:33 link/ether 02:42:f0:1e:f6:71 brd ff:ff:ff:ff:ff:ff 09:09:33 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 09:09:33 valid_lft forever preferred_lft forever 09:09:33 09:09:33 09:09:33 ---> sar -b -r -n DEV: 09:09:33 Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-4803) 07/03/26 _x86_64_ (8 CPU) 09:09:33 09:09:33 09:04:00 LINUX RESTART (8 CPU) 09:09:33 09:09:33 09:05:02 tps rtps wtps bread/s bwrtn/s 09:09:33 09:06:01 60.94 0.15 60.79 4.07 58060.94 09:09:33 09:07:01 24.96 0.02 24.95 2.67 548.44 09:09:33 09:08:01 30.00 0.00 30.00 0.00 656.16 09:09:33 09:09:01 160.01 21.25 138.76 798.40 15880.95 09:09:33 Average: 69.01 5.38 63.63 202.11 18622.32 09:09:33 09:09:33 09:05:02 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 09:09:33 09:06:01 29841960 31741696 3097260 9.40 46088 2166768 1338556 4.06 1246192 1557872 1560 09:09:33 09:07:01 29842924 31744132 3096296 9.40 46356 2168004 1320600 4.01 1248620 1556156 1372 09:09:33 09:08:01 29578584 31482596 3360636 10.20 46700 2169968 1748244 5.31 1506400 1557164 1076 09:09:33 09:09:01 29402468 31631448 3536752 10.74 77732 2446836 1442540 4.38 1392992 1812388 6068 09:09:33 Average: 29666484 31649968 3272736 9.94 54219 2237894 1462485 4.44 1348551 1620895 2519 09:09:33 09:09:33 09:05:02 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 09:09:33 09:06:01 ens3 1.69 0.58 0.50 0.53 0.00 0.00 0.00 0.00 09:09:33 09:06:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:09:33 09:06:01 lo 176.51 176.51 74.95 74.95 0.00 0.00 0.00 0.00 09:09:33 09:07:01 ens3 1.00 0.60 0.48 0.80 0.00 0.00 0.00 0.00 09:09:33 09:07:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:09:33 09:07:01 lo 165.01 165.01 70.51 70.51 0.00 0.00 0.00 0.00 09:09:33 09:08:01 ens3 0.35 0.18 0.07 0.26 0.00 0.00 0.00 0.00 09:09:33 09:08:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:09:33 09:08:01 lo 186.42 186.42 80.79 80.79 0.00 0.00 0.00 0.00 09:09:33 09:09:01 ens3 76.99 58.79 1055.53 12.38 0.00 0.00 0.00 0.00 09:09:33 09:09:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:09:33 09:09:01 lo 180.57 180.57 76.59 76.59 0.00 0.00 0.00 0.00 09:09:33 Average: ens3 20.08 15.10 265.25 3.50 0.00 0.00 0.00 0.00 09:09:33 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:09:33 Average: lo 177.13 177.13 75.71 75.71 0.00 0.00 0.00 0.00 09:09:33 09:09:33 09:09:33 ---> sar -P ALL: 09:09:33 Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-4803) 07/03/26 _x86_64_ (8 CPU) 09:09:33 09:09:33 09:04:00 LINUX RESTART (8 CPU) 09:09:33 09:09:33 09:05:02 CPU %user %nice %system %iowait %steal %idle 09:09:33 09:06:01 all 5.50 0.00 0.77 0.49 0.04 93.21 09:09:33 09:06:01 0 4.28 0.00 0.71 0.02 0.03 94.95 09:09:33 09:06:01 1 5.96 0.00 0.87 1.02 0.05 92.10 09:09:33 09:06:01 2 5.20 0.00 0.73 0.02 0.03 94.01 09:09:33 09:06:01 3 4.72 0.00 0.71 0.14 0.03 94.40 09:09:33 09:06:01 4 7.05 0.00 0.87 0.10 0.05 91.93 09:09:33 09:06:01 5 5.24 0.00 0.77 0.03 0.03 93.93 09:09:33 09:06:01 6 5.83 0.00 0.71 2.56 0.03 90.87 09:09:33 09:06:01 7 5.67 0.00 0.76 0.02 0.03 93.51 09:09:33 09:07:01 all 5.22 0.00 0.79 0.03 0.04 93.93 09:09:33 09:07:01 0 5.85 0.00 0.67 0.00 0.02 93.47 09:09:33 09:07:01 1 4.45 0.00 0.82 0.00 0.03 94.70 09:09:33 09:07:01 2 5.62 0.00 0.97 0.00 0.03 93.38 09:09:33 09:07:01 3 5.01 0.00 0.70 0.03 0.03 94.22 09:09:33 09:07:01 4 4.86 0.00 0.85 0.00 0.03 94.25 09:09:33 09:07:01 5 5.38 0.00 0.75 0.02 0.03 93.82 09:09:33 09:07:01 6 5.55 0.00 0.63 0.13 0.03 93.65 09:09:33 09:07:01 7 5.01 0.00 0.88 0.02 0.05 94.04 09:09:33 09:08:01 all 6.12 0.00 0.92 0.03 0.04 92.89 09:09:33 09:08:01 0 8.00 0.00 0.89 0.02 0.05 91.05 09:09:33 09:08:01 1 5.06 0.00 0.97 0.02 0.03 93.93 09:09:33 09:08:01 2 4.36 0.00 0.90 0.02 0.03 94.69 09:09:33 09:08:01 3 4.73 0.00 0.67 0.02 0.03 94.55 09:09:33 09:08:01 4 7.28 0.00 1.02 0.00 0.05 91.66 09:09:33 09:08:01 5 6.02 0.00 0.97 0.02 0.03 92.96 09:09:33 09:08:01 6 6.27 0.00 0.95 0.17 0.05 92.56 09:09:33 09:08:01 7 7.32 0.00 0.97 0.00 0.05 91.67 09:09:33 09:09:01 all 13.86 0.00 1.42 0.70 0.06 83.96 09:09:33 09:09:01 0 8.96 0.00 1.44 1.64 0.05 87.92 09:09:33 09:09:01 1 16.23 0.00 1.47 0.89 0.07 81.34 09:09:33 09:09:01 2 12.76 0.00 1.07 0.42 0.05 85.70 09:09:33 09:09:01 3 23.09 0.00 1.94 0.75 0.07 74.15 09:09:33 09:09:01 4 16.97 0.00 1.42 0.25 0.05 81.31 09:09:33 09:09:01 5 9.96 0.00 1.31 0.12 0.05 88.57 09:09:33 09:09:01 6 15.26 0.00 1.77 1.39 0.05 81.53 09:09:33 09:09:01 7 7.63 0.00 0.95 0.18 0.05 91.18 09:09:33 Average: all 7.68 0.00 0.97 0.31 0.04 90.99 09:09:33 Average: 0 6.78 0.00 0.93 0.42 0.04 91.83 09:09:33 Average: 1 7.93 0.00 1.03 0.48 0.05 90.51 09:09:33 Average: 2 6.99 0.00 0.92 0.11 0.04 91.94 09:09:33 Average: 3 9.41 0.00 1.01 0.23 0.04 89.31 09:09:33 Average: 4 9.05 0.00 1.04 0.09 0.05 89.78 09:09:33 Average: 5 6.65 0.00 0.95 0.05 0.04 92.32 09:09:33 Average: 6 8.23 0.00 1.02 1.06 0.04 89.65 09:09:33 Average: 7 6.41 0.00 0.89 0.05 0.05 92.60 09:09:33 09:09:33 09:09:33