By type
2021-10-20 12:36:51,667 - xtesting.ci.run_tests - INFO - Deployment description:
+-------------------------+----------------------------------------------------------+
| ENV VAR | VALUE |
+-------------------------+----------------------------------------------------------+
| CI_LOOP | daily |
| DEBUG | false |
| DEPLOY_SCENARIO | onap-nofeature-noha |
| INSTALLER_TYPE | ci_ds |
| BUILD_TAG | ci-ds-2021-10-20-12-09-55 |
| NODE_NAME | ci-dualstack-master-daily |
| TEST_DB_URL | http://testresults.opnfv.org/onap/api/v1/results |
| TEST_DB_EXT_URL | |
| S3_ENDPOINT_URL | |
| S3_DST_URL | |
| HTTP_DST_URL | |
+-------------------------+----------------------------------------------------------+
2021-10-20 12:36:51,672 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED:
+---------------------+---------------+------------------------------------------+--------------------------------------------+
| TIERS | ORDER | DESCRIPTION | TESTCASES |
+---------------------+---------------+------------------------------------------+--------------------------------------------+
| healthcheck | 1 | Set of basic Functional tests to | core small medium full postinstall |
| | | validate the ONAP installation. | healthdist |
+---------------------+---------------+------------------------------------------+--------------------------------------------+
2021-10-20 12:36:51,702 - xtesting.ci.run_tests - INFO - Loading test case 'core'...
2021-10-20 12:36:52,055 - xtesting.ci.run_tests - INFO - Running test case 'core'...
(DMaaP:UP)
2021-10-20 12:37:01,775 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router PubSub Health Check | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | PASS |
7 critical tests, 7 passed, 0 failed
7 tests total, 7 passed, 0 failed
==============================================================================
Output: /var/lib/xtesting/results/core/output.xml
2021-10-20 12:37:01,798 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-10-20 12:37:01,953 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-10-20 12:37:01,953 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| core | integration | 00:10 | PASS |
+-------------------+---------------------+------------------+----------------+
2021-10-20 12:37:02,388 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/61700d6e6c44f50010577617
2021-10-20 12:37:02,412 - xtesting.ci.run_tests - INFO - Loading test case 'small'...
2021-10-20 12:37:02,435 - xtesting.ci.run_tests - INFO - Running test case 'small'...
(DMaaP:UP)
2021-10-20 12:37:17,069 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | FAIL |
ConnectionError: HTTPSConnectionPool(host='appc.onap', port=8443): Max retries exceeded with url: /restconf/operations/SLI-API:healthcheck (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name does not resolve'))
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router PubSub Health Check | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
15 critical tests, 14 passed, 1 failed
15 tests total, 14 passed, 1 failed
==============================================================================
Output: /var/lib/xtesting/results/small/output.xml
2021-10-20 12:37:17,111 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-10-20 12:37:17,325 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-10-20 12:37:17,326 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| small | integration | 00:15 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-10-20 12:37:17,719 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/61700d7d6c44f50010577618
2021-10-20 12:37:17,719 - xtesting.ci.run_tests - ERROR - The test case 'small' failed.
2021-10-20 12:37:17,747 - xtesting.ci.run_tests - INFO - Loading test case 'medium'...
2021-10-20 12:37:17,770 - xtesting.ci.run_tests - INFO - Running test case 'medium'...
(DMaaP:UP)
2021-10-20 12:37:43,456 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | FAIL |
ConnectionError: HTTPSConnectionPool(host='appc.onap', port=8443): Max retries exceeded with url: /restconf/operations/SLI-API:healthcheck (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name does not resolve'))
------------------------------------------------------------------------------
Basic CLAMP Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Health Check | FAIL |
500 != 200
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router PubSub Health Check | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-Homing Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-SNIRO Health Check | FAIL |
400 != 200
------------------------------------------------------------------------------
Basic OOF-CMSO Health Check | FAIL |
ConnectionError: HTTPSConnectionPool(host='oof-cmso.onap', port=8080): Max retries exceeded with url: /cmso/v1/health?checkInterfaces=true (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name does not resolve'))
------------------------------------------------------------------------------
Basic Policy Health Check | PASS |
------------------------------------------------------------------------------
Basic Policy New Healthcheck | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic UseCaseUI API Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Basic CDS Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
24 critical tests, 20 passed, 4 failed
24 tests total, 20 passed, 4 failed
==============================================================================
Output: /var/lib/xtesting/results/medium/output.xml
2021-10-20 12:37:43,521 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-10-20 12:37:43,781 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-10-20 12:37:43,782 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| medium | integration | 00:26 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-10-20 12:37:44,172 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/61700d986c44f50010577619
2021-10-20 12:37:44,172 - xtesting.ci.run_tests - ERROR - The test case 'medium' failed.
2021-10-20 12:37:44,199 - xtesting.ci.run_tests - INFO - Loading test case 'full'...
2021-10-20 12:37:44,252 - xtesting.ci.run_tests - INFO - Running test case 'full'...
(DMaaP:UP)
2021-10-20 12:38:03,014 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Basic A&AI Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF Health Check | PASS |
------------------------------------------------------------------------------
Basic AAF SMS Health Check | PASS |
------------------------------------------------------------------------------
Basic APPC Health Check | FAIL |
ConnectionError: HTTPSConnectionPool(host='appc.onap', port=8443): Max retries exceeded with url: /restconf/operations/SLI-API:healthcheck (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name does not resolve'))
------------------------------------------------------------------------------
Basic CLI Health Check | PASS |
------------------------------------------------------------------------------
Basic CLAMP Health Check | PASS |
------------------------------------------------------------------------------
Basic DCAE Health Check | FAIL |
500 != 200
------------------------------------------------------------------------------
Basic DMAAP Data Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Message Router Health Check | PASS |
------------------------------------------------------------------------------
Basic DMAAP Bus Controller Health Check With Basic Auth | PASS |
------------------------------------------------------------------------------
Basic External API NBI Health Check | PASS |
------------------------------------------------------------------------------
Basic Microservice Bus Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-pike API Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-starlingx API Health Check | FAIL |
502 != 200
------------------------------------------------------------------------------
Basic Multicloud-titanium_cloud API Health Check | FAIL |
502 != 200
------------------------------------------------------------------------------
Basic Multicloud-vio API Health Check | FAIL |
502 != 200
------------------------------------------------------------------------------
Basic Multicloud-k8s API Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-Homing Health Check | PASS |
------------------------------------------------------------------------------
Basic OOF-SNIRO Health Check | FAIL |
400 != 200
------------------------------------------------------------------------------
Basic OOF-CMSO Health Check | FAIL |
ConnectionError: HTTPSConnectionPool(host='oof-cmso.onap', port=8080): Max retries exceeded with url: /cmso/v1/health?checkInterfaces=true (Caused by NewConnectionError(': Failed to establish a new connection: [Errno -2] Name does not resolve'))
------------------------------------------------------------------------------
Basic Policy Health Check | PASS |
------------------------------------------------------------------------------
Basic Policy New Healthcheck | PASS |
------------------------------------------------------------------------------
Basic Portal Health Check | PASS |
------------------------------------------------------------------------------
Basic SDC Health Check | PASS |
------------------------------------------------------------------------------
Basic SDNC Health Check | PASS |
------------------------------------------------------------------------------
Basic SO Health Check | PASS |
------------------------------------------------------------------------------
Basic UseCaseUI API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC gvnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC huaweivnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC nslcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnflcm API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfmgr API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC vnfres API Health Check | PASS |
------------------------------------------------------------------------------
Basic VFC ztevnfmdriver API Health Check | PASS |
------------------------------------------------------------------------------
Basic VID Health Check | PASS |
------------------------------------------------------------------------------
Basic VNFSDK Health Check | PASS |
------------------------------------------------------------------------------
Basic Multicloud-fcaps API Health Check | PASS |
------------------------------------------------------------------------------
Basic Modeling genericparser API Health Check | PASS |
------------------------------------------------------------------------------
Basic CDS Health Check | PASS |
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
40 critical tests, 33 passed, 7 failed
40 tests total, 33 passed, 7 failed
==============================================================================
Output: /var/lib/xtesting/results/full/output.xml
2021-10-20 12:38:03,084 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-10-20 12:38:03,372 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-10-20 12:38:03,372 - xtesting.ci.run_tests - INFO - Test result:
+-------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+---------------------+------------------+----------------+
| full | integration | 00:19 | FAIL |
+-------------------+---------------------+------------------+----------------+
2021-10-20 12:38:03,767 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/61700dab6c44f5001057761a
2021-10-20 12:38:03,768 - xtesting.ci.run_tests - ERROR - The test case 'full' failed.
2021-10-20 12:38:03,805 - xtesting.ci.run_tests - INFO - Loading test case 'postinstall'...
2021-10-20 12:38:03,834 - xtesting.ci.run_tests - INFO - Running test case 'postinstall'...
2021-10-20 12:38:05,136 - xtesting.core.robotframework - INFO -
==============================================================================
Post-Install-Tests :: Testing Installation
==============================================================================
Basic DMAAP Message Router ACL Update Test | PASS |
------------------------------------------------------------------------------
Basic AAI Service Design Models Size Test | PASS |
------------------------------------------------------------------------------
Post-Install-Tests :: Testing Installation | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Output: /var/lib/xtesting/results/postinstall/output.xml
2021-10-20 12:38:05,144 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-10-20 12:38:05,242 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-10-20 12:38:05,242 - xtesting.ci.run_tests - INFO - Test result:
+---------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+---------------------+---------------------+------------------+----------------+
| postinstall | integration | 00:01 | PASS |
+---------------------+---------------------+------------------+----------------+
2021-10-20 12:38:05,672 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/61700dad6c44f5001057761b
2021-10-20 12:38:05,697 - xtesting.ci.run_tests - INFO - Loading test case 'healthdist'...
2021-10-20 12:38:05,723 - xtesting.ci.run_tests - INFO - Running test case 'healthdist'...
2021-10-20 12:38:10,744 - xtesting.core.robotframework - INFO -
==============================================================================
Health-Check :: Test that ONAP components are available via basic API calls
==============================================================================
Health Distribution Test | FAIL |
417 != 200
Also keyword teardown failed:
Variable '${catalog_service_id}' not found.
------------------------------------------------------------------------------
Health-Check :: Test that ONAP components are available via basic ... | FAIL |
1 critical test, 0 passed, 1 failed
1 test total, 0 passed, 1 failed
==============================================================================
Output: /var/lib/xtesting/results/healthdist/output.xml
2021-10-20 12:38:10,756 - xtesting.core.robotframework - INFO - Results were successfully parsed
2021-10-20 12:38:10,872 - xtesting.core.robotframework - INFO - Results were successfully generated
2021-10-20 12:38:10,872 - xtesting.ci.run_tests - INFO - Test result:
+--------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+--------------------+---------------------+------------------+----------------+
| healthdist | integration | 00:05 | FAIL |
+--------------------+---------------------+------------------+----------------+
2021-10-20 12:38:11,263 - xtesting.core.testcase - INFO - The results were successfully pushed to DB:
http://testresults.opnfv.org/onap/api/v1/results/61700db36c44f5001057761c
2021-10-20 12:38:11,263 - xtesting.ci.run_tests - ERROR - The test case 'healthdist' failed.
2021-10-20 12:38:11,264 - xtesting.ci.run_tests - INFO - Xtesting report:
+---------------------+---------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+---------------------+---------------------+---------------------+------------------+----------------+
| core | integration | healthcheck | 00:10 | PASS |
| small | integration | healthcheck | 00:15 | FAIL |
| medium | integration | healthcheck | 00:26 | FAIL |
| full | integration | healthcheck | 00:19 | FAIL |
| postinstall | integration | healthcheck | 00:01 | PASS |
| healthdist | integration | healthcheck | 00:05 | FAIL |
+---------------------+---------------------+---------------------+------------------+----------------+
2021-10-20 12:38:11,268 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR