Triggered by Gerrit: https://gerrit.onap.org/r/c/oom/readiness/+/137547 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on prd-ubuntu1804-docker-8c-8g-16607 (ubuntu1804-docker-8c-8g) in workspace /w/workspace/oom-readiness-docker-verify-master [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-N82ksM5tlNpR/agent.2097 SSH_AGENT_PID=2099 [ssh-agent] Started. Running ssh-add (command line suppressed) Identity added: /w/workspace/oom-readiness-docker-verify-master@tmp/private_key_14931475190868441962.key (/w/workspace/oom-readiness-docker-verify-master@tmp/private_key_14931475190868441962.key) [ssh-agent] Using credentials onap-jobbuiler (Gerrit user) The recommended git tool is: NONE using credential onap-jenkins-ssh Wiping out workspace first. Cloning the remote Git repository Cloning repository git://cloud.onap.org/mirror/oom/readiness > git init /w/workspace/oom-readiness-docker-verify-master # timeout=10 Fetching upstream changes from git://cloud.onap.org/mirror/oom/readiness > git --version # timeout=10 > git --version # 'git version 2.17.1' using GIT_SSH to set credentials Gerrit user Verifying host key using manually-configured host key entries > git fetch --tags --progress -- git://cloud.onap.org/mirror/oom/readiness +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://cloud.onap.org/mirror/oom/readiness # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git://cloud.onap.org/mirror/oom/readiness # timeout=10 Fetching upstream changes from git://cloud.onap.org/mirror/oom/readiness using GIT_SSH to set credentials Gerrit user Verifying host key using manually-configured host key entries > git fetch --tags --progress -- git://cloud.onap.org/mirror/oom/readiness refs/changes/47/137547/2 # timeout=10 > git rev-parse ee99ae32bb88bb21a5596a21f3bb4e162eca7196^{commit} # timeout=10 Checking out Revision ee99ae32bb88bb21a5596a21f3bb4e162eca7196 (refs/changes/47/137547/2) > git config core.sparsecheckout # timeout=10 > git checkout -f ee99ae32bb88bb21a5596a21f3bb4e162eca7196 # timeout=10 Commit message: "[READINESS] Add new feature to check the service readiness" > git rev-parse FETCH_HEAD^{commit} # timeout=10 > git rev-list --no-walk 9320a0c4f473cce293cf084f2acdd4d3ec514121 # timeout=10 provisioning config files... copy managed file [npmrc] to file:/home/jenkins/.npmrc copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins5228260386439947717.sh ---> python-tools-install.sh Setup pyenv: * system (set by /opt/pyenv/version) * 3.8.13 (set by /opt/pyenv/version) * 3.9.13 (set by /opt/pyenv/version) * 3.10.6 (set by /opt/pyenv/version) lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-oJbE lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-oJbE/bin to PATH Generating Requirements File Python 3.10.6 pip 24.0 from /tmp/venv-oJbE/lib/python3.10/site-packages/pip (python 3.10) appdirs==1.4.4 argcomplete==3.2.3 aspy.yaml==1.3.0 attrs==23.2.0 autopage==0.5.2 beautifulsoup4==4.12.3 boto3==1.34.68 botocore==1.34.68 bs4==0.0.2 cachetools==5.3.3 certifi==2024.2.2 cffi==1.16.0 cfgv==3.4.0 chardet==5.2.0 charset-normalizer==3.3.2 click==8.1.7 cliff==4.6.0 cmd2==2.4.3 cryptography==3.3.2 debtcollector==3.0.0 decorator==5.1.1 defusedxml==0.7.1 Deprecated==1.2.14 distlib==0.3.8 dnspython==2.6.1 docker==4.2.2 dogpile.cache==1.3.2 email_validator==2.1.1 filelock==3.13.1 future==1.0.0 gitdb==4.0.11 GitPython==3.1.42 google-auth==2.29.0 httplib2==0.22.0 identify==2.5.35 idna==3.6 importlib-resources==1.5.0 iso8601==2.1.0 Jinja2==3.1.3 jmespath==1.0.1 jsonpatch==1.33 jsonpointer==2.4 jsonschema==4.21.1 jsonschema-specifications==2023.12.1 keystoneauth1==5.6.0 kubernetes==29.0.0 lftools==0.37.10 lxml==5.1.0 MarkupSafe==2.1.5 msgpack==1.0.8 multi_key_dict==2.0.3 munch==4.0.0 netaddr==1.2.1 netifaces==0.11.0 niet==1.4.2 nodeenv==1.8.0 oauth2client==4.1.3 oauthlib==3.2.2 openstacksdk==3.0.0 os-client-config==2.1.0 os-service-types==1.7.0 osc-lib==3.0.1 oslo.config==9.4.0 oslo.context==5.5.0 oslo.i18n==6.3.0 oslo.log==5.5.0 oslo.serialization==5.4.0 oslo.utils==7.1.0 packaging==24.0 pbr==6.0.0 platformdirs==4.2.0 prettytable==3.10.0 pyasn1==0.5.1 pyasn1-modules==0.3.0 pycparser==2.21 pygerrit2==2.0.15 PyGithub==2.2.0 pyinotify==0.9.6 PyJWT==2.8.0 PyNaCl==1.5.0 pyparsing==2.4.7 pyperclip==1.8.2 pyrsistent==0.20.0 python-cinderclient==9.5.0 python-dateutil==2.9.0.post0 python-heatclient==3.5.0 python-jenkins==1.8.2 python-keystoneclient==5.4.0 python-magnumclient==4.4.0 python-novaclient==18.6.0 python-openstackclient==6.6.0 python-swiftclient==4.5.0 PyYAML==6.0.1 referencing==0.34.0 requests==2.31.0 requests-oauthlib==1.4.0 requestsexceptions==1.4.0 rfc3986==2.0.0 rpds-py==0.18.0 rsa==4.9 ruamel.yaml==0.18.6 ruamel.yaml.clib==0.2.8 s3transfer==0.10.1 simplejson==3.19.2 six==1.16.0 smmap==5.0.1 soupsieve==2.5 stevedore==5.2.0 tabulate==0.9.0 toml==0.10.2 tomlkit==0.12.4 tqdm==4.66.2 typing_extensions==4.10.0 tzdata==2024.1 urllib3==1.26.18 virtualenv==20.25.1 wcwidth==0.2.13 websocket-client==1.7.0 wrapt==1.16.0 xdg==6.0.0 xmltodict==0.13.0 yq==3.2.3 provisioning config files... copy managed file [global-settings] to file:/w/workspace/oom-readiness-docker-verify-master@tmp/config5006905623894376750tmp copy managed file [oom-settings] to file:/w/workspace/oom-readiness-docker-verify-master@tmp/config17234428072299779290tmp [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins12187948035066259714.sh ---> docker-login.sh nexus3.onap.org:10001 WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded nexus3.onap.org:10002 WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded nexus3.onap.org:10003 WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded nexus3.onap.org:10004 WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded docker.io WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded ---> docker-login.sh ends [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins9408931025348282108.sh [oom-readiness-docker-verify-master] $ /bin/sh -xe /tmp/jenkins18347974807516501861.sh [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content DOCKER_ROOT=$WORKSPACE CONTAINER_TAG_YAML_DIR= CONTAINER_TAG_METHOD=latest [EnvInject] - Variables injected successfully. [oom-readiness-docker-verify-master] $ /bin/bash -l /tmp/jenkins3562875324598002119.sh ---> docker-get-container-tag.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/oom-readiness-docker-verify-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-oJbE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: yq lf-activate-venv(): INFO: Adding /tmp/venv-oJbE/bin to PATH ---> Docker image tag found: latest [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties file path 'env_docker_inject.txt' [EnvInject] - Variables injected successfully. [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content DOCKER_ARGS=-f ./Dockerfile DOCKER_ROOT=/w/workspace/oom-readiness-docker-verify-master CONTAINER_PULL_REGISTRY=nexus3.onap.org:10001 CONTAINER_PUSH_REGISTRY=nexus3.onap.org:10003 DOCKER_NAME=onap/oom/readiness [EnvInject] - Variables injected successfully. [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins311858164951736106.sh ---> docker-build.sh Docker version 20.10.18, build b40c2f6 Building image: nexus3.onap.org:10003/onap/oom/readiness:latest docker build -f ./Dockerfile -t nexus3.onap.org:10003/onap/oom/readiness:latest . Sending build context to Docker daemon 290.3kB Step 1/6 : FROM nexus3.onap.org:10001/onap/integration-python:12.0.0 12.0.0: Pulling from onap/integration-python f56be85fc22e: Pulling fs layer 8f2cb45389d7: Pulling fs layer 40cf4a69a8c6: Pulling fs layer 1f9b743b3912: Pulling fs layer c2d4879139cb: Pulling fs layer 7bfee93fd017: Pulling fs layer 7bfee93fd017: Waiting 1f9b743b3912: Waiting 8f2cb45389d7: Verifying Checksum 8f2cb45389d7: Download complete 1f9b743b3912: Verifying Checksum 1f9b743b3912: Download complete f56be85fc22e: Verifying Checksum f56be85fc22e: Download complete 7bfee93fd017: Verifying Checksum 7bfee93fd017: Download complete c2d4879139cb: Verifying Checksum c2d4879139cb: Download complete 40cf4a69a8c6: Download complete f56be85fc22e: Pull complete 8f2cb45389d7: Pull complete 40cf4a69a8c6: Pull complete 1f9b743b3912: Pull complete c2d4879139cb: Pull complete 7bfee93fd017: Pull complete Digest: sha256:2fbc724432f17e5b8529d0663535972c6dd22e2946e83630c3a3748bcd1a6e1c Status: Downloaded newer image for nexus3.onap.org:10001/onap/integration-python:12.0.0 ---> 2834f89bf9f5 Step 2/6 : ENV CERT="/var/run/secrets/kubernetes.io/serviceaccount/ca.crt" ---> Running in b609bccaa927 Removing intermediate container b609bccaa927 ---> f0fde55ce8d9 Step 3/6 : ENV TOKEN="/var/run/secrets/kubernetes.io/serviceaccount/token" ---> Running in 14b46b9dfbbf Removing intermediate container 14b46b9dfbbf ---> 74b2c8dbff39 Step 4/6 : COPY ready.py . ---> e5d99c4ebfcd Step 5/6 : ENTRYPOINT ["/app/ready.py"] ---> Running in 74cf5aad45d0 Removing intermediate container 74cf5aad45d0 ---> 1ee03173c339 Step 6/6 : CMD [""] ---> Running in 2366fc1f6f80 Removing intermediate container 2366fc1f6f80 ---> 43000b59210b Successfully built 43000b59210b Successfully tagged nexus3.onap.org:10003/onap/oom/readiness:latest ---> docker-build.sh ends [oom-readiness-docker-verify-master] $ /bin/sh -xe /tmp/jenkins4984923439586381843.sh [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins626673641368914757.sh $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 2099 killed; [ssh-agent] Stopped. [PostBuildScript] - [INFO] Executing post build scripts. [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins14201620091244741636.sh ---> sysstat.sh [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins16007042383838313885.sh ---> package-listing.sh ++ facter osfamily ++ tr '[:upper:]' '[:lower:]' + OS_FAMILY=debian + workspace=/w/workspace/oom-readiness-docker-verify-master + START_PACKAGES=/tmp/packages_start.txt + END_PACKAGES=/tmp/packages_end.txt + DIFF_PACKAGES=/tmp/packages_diff.txt + PACKAGES=/tmp/packages_start.txt + '[' /w/workspace/oom-readiness-docker-verify-master ']' + PACKAGES=/tmp/packages_end.txt + case "${OS_FAMILY}" in + dpkg -l + grep '^ii' + '[' -f /tmp/packages_start.txt ']' + '[' -f /tmp/packages_end.txt ']' + diff /tmp/packages_start.txt /tmp/packages_end.txt + '[' /w/workspace/oom-readiness-docker-verify-master ']' + mkdir -p /w/workspace/oom-readiness-docker-verify-master/archives/ + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/oom-readiness-docker-verify-master/archives/ [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins3068915749329348034.sh ---> capture-instance-metadata.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/oom-readiness-docker-verify-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-oJbE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-oJbE/bin to PATH INFO: Running in OpenStack, capturing instance metadata [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins14903299016491730089.sh provisioning config files... copy managed file [jenkins-log-archives-settings] to file:/w/workspace/oom-readiness-docker-verify-master@tmp/config1015101794445008089tmp Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] Run condition [Regular expression match] preventing perform for step [Provide Configuration files] [EnvInject] - Injecting environment variables from a build step. [EnvInject] - Injecting as environment variables the properties content SERVER_ID=logs [EnvInject] - Variables injected successfully. [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins3640744464512178134.sh ---> create-netrc.sh [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins11532240863619658592.sh ---> python-tools-install.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/oom-readiness-docker-verify-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-oJbE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-oJbE/bin to PATH [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins12949513357031321834.sh ---> sudo-logs.sh Archiving 'sudo' log.. [oom-readiness-docker-verify-master] $ /bin/bash /tmp/jenkins1502206457107664368.sh ---> job-cost.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/oom-readiness-docker-verify-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-oJbE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 lf-activate-venv(): INFO: Adding /tmp/venv-oJbE/bin to PATH INFO: No Stack... INFO: Retrieving Pricing Info for: v3-standard-8 INFO: Archiving Costs [oom-readiness-docker-verify-master] $ /bin/bash -l /tmp/jenkins3872289655016361030.sh ---> logs-deploy.sh Setup pyenv: system 3.8.13 3.9.13 * 3.10.6 (set by /w/workspace/oom-readiness-docker-verify-master/.python-version) lf-activate-venv(): INFO: Reuse venv:/tmp/venv-oJbE from file:/tmp/.os_lf_venv lf-activate-venv(): INFO: Installing: lftools lf-activate-venv(): INFO: Adding /tmp/venv-oJbE/bin to PATH INFO: Nexus URL https://nexus.onap.org path production/vex-yul-ecomp-jenkins-1/oom-readiness-docker-verify-master/49 INFO: archiving workspace using pattern(s): Archives upload complete. INFO: archiving logs to Nexus ---> uname -a: Linux prd-ubuntu1804-docker-8c-8g-16607 4.15.0-192-generic #203-Ubuntu SMP Wed Aug 10 17:40:03 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux ---> lscpu: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 8 On-line CPU(s) list: 0-7 Thread(s) per core: 1 Core(s) per socket: 1 Socket(s): 8 NUMA node(s): 1 Vendor ID: AuthenticAMD CPU family: 23 Model: 49 Model name: AMD EPYC-Rome Processor Stepping: 0 CPU MHz: 2800.000 BogoMIPS: 5600.00 Virtualization: AMD-V Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 512K L3 cache: 16384K NUMA node0 CPU(s): 0-7 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl xtopology cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr arat npt nrip_save umip rdpid arch_capabilities ---> nproc: 8 ---> df -h: Filesystem Size Used Avail Use% Mounted on udev 16G 0 16G 0% /dev tmpfs 3.2G 708K 3.2G 1% /run /dev/vda1 155G 10G 145G 7% / tmpfs 16G 0 16G 0% /dev/shm tmpfs 5.0M 0 5.0M 0% /run/lock tmpfs 16G 0 16G 0% /sys/fs/cgroup /dev/vda15 105M 4.4M 100M 5% /boot/efi tmpfs 3.2G 0 3.2G 0% /run/user/1001 ---> free -m: total used free shared buff/cache available Mem: 32167 846 29173 0 2147 30899 Swap: 1023 0 1023 ---> ip addr: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: ens3: mtu 1458 qdisc mq state UP group default qlen 1000 link/ether fa:16:3e:60:af:14 brd ff:ff:ff:ff:ff:ff inet 10.30.107.190/23 brd 10.30.107.255 scope global dynamic ens3 valid_lft 86219sec preferred_lft 86219sec inet6 fe80::f816:3eff:fe60:af14/64 scope link valid_lft forever preferred_lft forever 3: docker0: mtu 1500 qdisc noqueue state DOWN group default link/ether 02:42:74:f4:58:70 brd ff:ff:ff:ff:ff:ff inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 valid_lft forever preferred_lft forever ---> sar -b -r -n DEV: Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-16607) 03/22/24 _x86_64_ (8 CPU) 15:26:17 LINUX RESTART (8 CPU) 15:27:02 tps rtps wtps bread/s bwrtn/s 15:28:01 95.27 18.40 76.87 1050.26 19348.45 15:29:01 118.36 7.50 110.86 1335.38 24078.65 Average: 106.91 12.91 94.01 1194.02 21733.42 15:27:02 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 15:28:01 30105408 31681348 2833812 8.60 68548 1819264 1393124 4.10 887924 1656024 154100 15:29:01 29879676 31645940 3059544 9.29 80244 1988124 1463332 4.31 1011716 1737016 19148 Average: 29992542 31663644 2946678 8.95 74396 1903694 1428228 4.20 949820 1696520 86624 15:27:02 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 15:28:01 ens3 60.84 40.77 889.84 10.34 0.00 0.00 0.00 0.00 15:28:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:28:01 lo 1.56 1.56 0.17 0.17 0.00 0.00 0.00 0.00 15:29:01 ens3 54.17 42.36 491.14 12.55 0.00 0.00 0.00 0.00 15:29:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:29:01 lo 3.33 3.33 0.31 0.31 0.00 0.00 0.00 0.00 Average: ens3 57.48 41.57 688.81 11.45 0.00 0.00 0.00 0.00 Average: docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 Average: lo 2.45 2.45 0.24 0.24 0.00 0.00 0.00 0.00 ---> sar -P ALL: Linux 4.15.0-192-generic (prd-ubuntu1804-docker-8c-8g-16607) 03/22/24 _x86_64_ (8 CPU) 15:26:17 LINUX RESTART (8 CPU) 15:27:02 CPU %user %nice %system %iowait %steal %idle 15:28:01 all 9.26 0.00 0.66 3.36 0.03 86.69 15:28:01 0 3.24 0.00 0.46 0.36 0.02 95.93 15:28:01 1 1.03 0.00 0.19 0.02 0.02 98.75 15:28:01 2 0.49 0.00 0.29 0.19 0.02 99.02 15:28:01 3 27.14 0.00 1.15 2.65 0.05 69.01 15:28:01 4 21.94 0.00 1.24 1.20 0.05 75.56 15:28:01 5 9.10 0.00 0.53 0.03 0.02 90.33 15:28:01 6 5.07 0.00 0.35 0.12 0.03 94.43 15:28:01 7 6.15 0.00 1.10 22.36 0.03 70.35 15:29:01 all 9.06 0.00 0.81 3.82 0.03 86.28 15:29:01 0 12.87 0.00 0.98 1.55 0.02 84.57 15:29:01 1 16.54 0.00 0.73 0.80 0.05 81.88 15:29:01 2 21.47 0.00 1.00 1.52 0.05 75.95 15:29:01 3 4.09 0.00 0.67 0.82 0.03 94.40 15:29:01 4 8.62 0.00 0.78 10.15 0.02 80.43 15:29:01 5 5.16 0.00 0.83 0.10 0.03 93.88 15:29:01 6 2.07 0.00 0.98 10.62 0.03 86.29 15:29:01 7 1.65 0.00 0.48 5.01 0.02 92.83 Average: all 9.16 0.00 0.74 3.59 0.03 86.48 Average: 0 8.09 0.00 0.72 0.96 0.02 90.21 Average: 1 8.85 0.00 0.46 0.41 0.03 90.24 Average: 2 11.06 0.00 0.65 0.86 0.03 87.40 Average: 3 15.51 0.00 0.91 1.72 0.04 81.81 Average: 4 15.23 0.00 1.01 5.71 0.03 78.02 Average: 5 7.11 0.00 0.68 0.07 0.03 92.12 Average: 6 3.57 0.00 0.67 5.38 0.03 90.35 Average: 7 3.88 0.00 0.79 13.62 0.03 81.68