By type
2021-04-07 09:15:08,073 - xtesting.ci.run_tests - INFO - Deployment description:
+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | onap-nofeature-noha |
| INSTALLER_TYPE | ci_ds |
| BUILD_TAG | dummy-smoke-usecases |
| NODE_NAME | ci-dualstack-master-daily |
| TEST_DB_URL | http://testresults.opnfv.org/onap/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+
2021-04-07 09:15:08,076 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED:
+---------------------+------------------------------------------+--------------------------------------------+
| TIERS | DESCRIPTION | TESTCASES |
+---------------------+------------------------------------------+--------------------------------------------+
| healthcheck | Set of basic Functional tests to | core small medium full postinstall |
| | validate the ONAP installation. | healthdist |
+---------------------+------------------------------------------+--------------------------------------------+
2021-04-07 09:15:08,100 - xtesting.ci.run_tests - INFO - Loading test case 'core'...
2021-04-07 09:15:08,321 - xtesting.ci.run_tests - INFO - Running test case 'core'...
2021-04-07 09:15:44,163 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Enhanced A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router PubSub Health Check | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | FAIL |
Test timeout 20 seconds exceeded.
------------------------------------------------------------------------------
Enhanced SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Enhanced SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
10 critical tests, 9 passed, 1 failed
10 tests total, 9 passed, 1 failed
==============================================================================
Output: /var/lib/xtesting/results/core/output.xml
2021-04-07 09:15:44,183 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-04-07 09:15:44,323 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-04-07 09:15:44,324 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| core | integration | 00:35 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-04-07 09:15:44,732 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/606d78406c44f50010937cc3
2021-04-07 09:15:44,733 - xtesting.ci.run_tests - ERROR - The test case 'core' failed.
2021-04-07 09:15:44,775 - xtesting.ci.run_tests - INFO - Loading test case 'small'...
2021-04-07 09:15:44,807 - xtesting.ci.run_tests - INFO - Running test case 'small'...
2021-04-07 09:16:20,628 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Enhanced A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | FAIL |
401 != 200
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router PubSub Health Check | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | FAIL |
Test timeout 20 seconds exceeded.
------------------------------------------------------------------------------
Enhanced SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Enhanced SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
18 critical tests, 16 passed, 2 failed
18 tests total, 16 passed, 2 failed
==============================================================================
Output: /var/lib/xtesting/results/small/output.xml
2021-04-07 09:16:20,663 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-04-07 09:16:20,856 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-04-07 09:16:20,856 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| small | integration | 00:35 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-04-07 09:16:21,254 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/606d78656c44f50010937cc4
2021-04-07 09:16:21,255 - xtesting.ci.run_tests - ERROR - The test case 'small' failed.
2021-04-07 09:16:21,280 - xtesting.ci.run_tests - INFO - Loading test case 'medium'...
2021-04-07 09:16:21,301 - xtesting.ci.run_tests - INFO - Running test case 'medium'...
2021-04-07 09:17:13,559 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Enhanced A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | FAIL |
401 != 200
------------------------------------------------------------------------------
Basic CLAMP Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Microservices Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router PubSub Health Check | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-Homing Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-OSDF Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-CMSO Health Check | PASS |
------------------------------------------------------------------------------
Basic Policy Health Check | PASS |
------------------------------------------------------------------------------
Enhanced Policy New Healthcheck | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | FAIL |
Test timeout 20 seconds exceeded.
------------------------------------------------------------------------------
Enhanced SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Enhanced SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic UseCaseUI API Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Enhanced CDS Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
28 critical tests, 26 passed, 2 failed
28 tests total, 26 passed, 2 failed
==============================================================================
Output: /var/lib/xtesting/results/medium/output.xml
2021-04-07 09:17:13,612 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-04-07 09:17:13,857 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-04-07 09:17:13,857 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| medium | integration | 00:52 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-04-07 09:17:14,260 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/606d789a6c44f50010937cc5
2021-04-07 09:17:14,261 - xtesting.ci.run_tests - ERROR - The test case 'medium' failed.
2021-04-07 09:17:14,284 - xtesting.ci.run_tests - INFO - Loading test case 'full'...
2021-04-07 09:17:14,305 - xtesting.ci.run_tests - INFO - Running test case 'full'...
2021-04-07 09:18:01,761 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Enhanced A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | FAIL |
401 != 200
------------------------------------------------------------------------------
Basic CLI Health Check | PASS |
------------------------------------------------------------------------------
Basic CLAMP Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Microservices Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Data Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Bus Controller Health Check With Basic Auth | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-starlingx API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-titanium_cloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-vio API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-k8s API Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-Homing Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-OSDF Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-CMSO Health Check | PASS |
------------------------------------------------------------------------------
Basic Policy Health Check | PASS |
------------------------------------------------------------------------------
Enhanced Policy New Healthcheck | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | FAIL |
Test timeout 20 seconds exceeded.
------------------------------------------------------------------------------
Enhanced SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Enhanced SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic UseCaseUI API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC gvnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC huaweivnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nslcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnflcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfmgr API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfres API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC ztevnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Basic VNFSDK Health Check | PASS |
------------------------------------------------------------------------------
Basic Holmes Rule Management API Health Check | PASS |
------------------------------------------------------------------------------
Basic Holmes Engine Management API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-fcaps API Health Check | PASS |
------------------------------------------------------------------------------
Basic Modeling genericparser API Health Check | PASS |
------------------------------------------------------------------------------
Enhanced CDS Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
46 critical tests, 44 passed, 2 failed
46 tests total, 44 passed, 2 failed
==============================================================================
Output: /var/lib/xtesting/results/full/output.xml
2021-04-07 09:18:01,833 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-04-07 09:18:02,138 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-04-07 09:18:02,138 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| full | integration | 00:47 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-04-07 09:18:02,553 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/606d78ca6c44f50010937cc6
2021-04-07 09:18:02,554 - xtesting.ci.run_tests - ERROR - The test case 'full' failed.
2021-04-07 09:18:02,575 - xtesting.ci.run_tests - INFO - Loading test case 'postinstall'...
2021-04-07 09:18:02,605 - xtesting.ci.run_tests - INFO - Running test case 'postinstall'...
2021-04-07 09:18:06,264 - xtesting.core.robotframework - INFO -
==============================================================================
Post-Install-Tests :: Testing Installation
==============================================================================
Basic DMAAP Message Router ACL Update Test | PASS |
------------------------------------------------------------------------------
Basic AAI Service Design Models Size Test | PASS |
------------------------------------------------------------------------------
Post-Install-Tests :: Testing Installation | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Output: /var/lib/xtesting/results/postinstall/output.xml
2021-04-07 09:18:06,273 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-04-07 09:18:06,360 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-04-07 09:18:06,360 - xtesting.ci.run_tests - INFO - Test result:
+---------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+---------------------+---------------------+------------------+----------------+
| postinstall | integration | 00:03 | PASS |
+---------------------+---------------------+------------------+----------------+
2021-04-07 09:18:06,758 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/606d78ce6c44f50010937cc7
2021-04-07 09:18:06,777 - xtesting.ci.run_tests - INFO - Loading test case 'healthdist'...
2021-04-07 09:18:06,798 - xtesting.ci.run_tests - INFO - Running test case 'healthdist'...
2021-04-07 09:19:26,021 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Health Distribution Test | FAIL |
400 != 201
Also keyword teardown failed:
Variable '${catalog_service_id}' not found.
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==============================================================================
Output: /var/lib/xtesting/results/healthdist/output.xml
2021-04-07 09:19:26,039 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-04-07 09:19:26,182 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-04-07 09:19:26,182 - xtesting.ci.run_tests - INFO - Test result:
+--------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+--------------------+---------------------+------------------+----------------+
| healthdist | integration | 01:19 | FAIL |
+--------------------+---------------------+------------------+----------------+
2021-04-07 09:19:26,731 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/606d791e6c44f50010937cc8
2021-04-07 09:19:26,731 - xtesting.ci.run_tests - ERROR - The test case 'healthdist' failed.
2021-04-07 09:19:26,731 - xtesting.ci.run_tests - INFO - Xtesting report:
+---------------------+---------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+---------------------+---------------------+---------------------+------------------+----------------+
| core | integration | healthcheck | 00:35 | FAIL |
| small | integration | healthcheck | 00:35 | FAIL |
| medium | integration | healthcheck | 00:52 | FAIL |
| full | integration | healthcheck | 00:47 | FAIL |
| postinstall | integration | healthcheck | 00:03 | PASS |
| healthdist | integration | healthcheck | 01:19 | FAIL |
+---------------------+---------------------+---------------------+------------------+----------------+
2021-04-07 09:19:26,734 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR