policy-csit | Invoking the robot tests from: clamp-health-check.robot clamp-db-restore.robot clamp-single-element-test.robot clamp-multiple-element-type-test.robot clamp-timeout-test.robot policy-csit | clamp-migrate-rollback.robot clamp-trace-test.robot clamp-slas.robot policy-csit | Run Robot test policy-csit | ROBOT_VARIABLES=-v DATA:/opt/robotworkspace/models/models-examples/src/main/resources/policies policy-csit | -v POLICY_RUNTIME_ACM_IP:policy-clamp-runtime-acm:6969 policy-csit | -v HTTP_PARTICIPANT_SIM1_IP:policy-clamp-ac-sim-ppnt-1:6969 policy-csit | -v HTTP_PARTICIPANT_SIM2_IP:policy-clamp-ac-sim-ppnt-2:6969 policy-csit | -v HTTP_PARTICIPANT_SIM3_IP:policy-clamp-ac-sim-ppnt-3:6969 policy-csit | -v POLICY_HTTP_PARTICIPANT:policy-clamp-ac-http-ppnt:6969 policy-csit | -v KAFKA_IP:kafka:9092 policy-csit | -v PROMETHEUS_IP:prometheus:9090 policy-csit | -v TEST_ENV:docker policy-csit | -v JAEGER_IP:jaeger:16686 policy-csit | Starting Robot test suites ... policy-csit | ============================================================================== policy-csit | clamp policy-csit | ============================================================================== policy-csit | clamp.Health Check Suite policy-csit | ============================================================================== policy-csit | HealthcheckAcm :: Healthcheck on Clamp Acm | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | HealthcheckParticipantHttp :: Healthcheck on Participant Http | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | HealthcheckParticipantSim :: Healthcheck on Participant Simulator | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | RegisterParticipants :: Register Participants. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.Health Check Suite | PASS | policy-csit | 4 tests, 4 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp.Database Restore Suite policy-csit | ============================================================================== policy-csit | InsertDataIntoDatabase :: Insert restored data into the Database. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | AcMigrationRestored :: Migration of an automation composition rest... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UpdateDataDatabase :: Update restored data into the Database. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ReviewAutomationCompositionRestored :: Review automation compositi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | AcDeleteRestored :: Undeploy and delete of an automation compositi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinitionsRestored :: Deprime and delete of the compositi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InsertDataIntoDatabase2 :: Insert restored data into the Database. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | SyncParticipant :: Manual sync participants. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | GetInstances :: Get all the instances from the database | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | AcDeleteRestored2 :: Undeploy and delete of an automation composit... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.Database Restore Suite | PASS | policy-csit | 10 tests, 10 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp.AC With Single Element Workflow policy-csit | ============================================================================== policy-csit | CommissionAutomationCompositionSimple :: Commission simple automat... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrimeACDefinitionsSimple :: Prime simple automation composition de... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationCompositionSimple :: Instantiate simple autom... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailDeployAutomationCompositionSimple :: Fail Simple Deploy automa... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnDeployAutomationCompositionSimple :: UnDeploy simple automation ... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnInstantiateAutomationCompositionSimple :: Delete simple automati... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinitionSimple :: DePrime and Delete simple automation c... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.AC With Single Element Workflow | PASS | policy-csit | 7 tests, 7 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp.AC with participant supporting multiple element types Workflow policy-csit | ============================================================================== policy-csit | CommissionACMultipleElementTypes :: Commission automation composit... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrimeACDefinition :: Prime automation composition definition | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationComposition :: Instantiate automation composi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailDeployAutomationComposition :: Fail Deploy automation composit... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnDeployAutomationComposition :: UnDeploy automation composition. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnInstantiateAutomationComposition :: Delete automation compositio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinition :: DePrime and Delete automation composition de... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.AC with participant supporting multiple element types Workflow | PASS | policy-csit | 7 tests, 7 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp.Timeout Suite policy-csit | ============================================================================== policy-csit | CommissionAcDefinitionTimeout :: Commission automation composition... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | TimeoutPrimeACDefinition :: Prime automation composition definitio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinitionTimeout :: DePrime and Delete automation composi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.Timeout Suite | PASS | policy-csit | 3 tests, 3 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp.Migration and Rollback Suite policy-csit | ============================================================================== policy-csit | CommissionAutomationComposition :: Commission automation compositi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | CommissionAcDefinitionMigrationFrom :: Commission automation compo... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | CommissionAcDefinitionMigrationTo :: Commission automation composi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrimeACDefinitions :: Prime automation composition definition | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailPrimeACDefinitionFrom :: Prime automation composition definiti... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrimeACDefinitionFrom :: Prime automation composition definition M... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrimeACDefinitionTo :: Prime automation composition definition Mig... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteUndeployedInstantiateAutomationComposition :: Delete Instant... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationComposition :: Instantiate automation composi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationCompositionTimeout :: Instantiate automation ... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeployAutomationCompositionTimeout :: Deploy automation compositio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteAutomationCompositionTimeout :: Delete automation compositio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationCompositionMigrationFrom :: Instantiate autom... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailPrepareAutomationCompositionMigrationFrom :: Fail Prepare auto... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrepareAutomationCompositionMigrationFrom :: Prepare automation co... | FAIL | policy-csit | [2] != [1, 2] policy-csit | ------------------------------------------------------------------------------ policy-csit | FailDeployAutomationCompositionMigration :: Fail Deploy automation... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeployAutomationComposition :: Deploy automation composition. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeployAutomationCompositionMigration :: Deploy automation composit... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | SendOutPropertiesToRuntime :: Send Out Properties To Runtime | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailReviewAutomationCompositionMigrationFrom :: Fail Review automa... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ReviewAutomationCompositionMigrationFrom :: Review automation comp... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailAutomationCompositionUpdate :: Fail update of an automation co... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | AutomationCompositionUpdateRollback :: Rollback automation composi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | AutomationCompositionUpdate :: Update of an automation composition. | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | PrecheckAutomationCompositionMigration :: Precheck Migration of an... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | AutomationCompositionMigrationTo :: Migration of an automation com... | FAIL | policy-csit | [1] != [0, 1] policy-csit | ------------------------------------------------------------------------------ policy-csit | FailAutomationCompositionMigration :: Fail Migration of an automat... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnInstantiateAutomationComposition :: UnDeploy and Delete automati... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailUnDeployAutomationCompositionMigrationTo :: Fail UnDeploy auto... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnDeployAutomationCompositionMigrationTo :: UnDeploy automation co... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailUnInstantiateAutomationCompositionMigrationTo :: Fail Delete a... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnInstantiateAutomationCompositionMigrationTo :: Delete automation... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationCompositionRollback :: Instantiate automation... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeployAutomationCompositionRollback :: Deploy automation for testi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailAutomationCompositionMigrationRollback :: Fail Migration of an... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | RollbackAutomationComposition :: Rollback of an automation composi... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnInstantiateAutomationCompositionRollback :: Undeploy and Delete ... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | InstantiateAutomationCompositionRollback2 :: Instantiate automatio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeployAutomationCompositionRollback2 :: Deploy automation for test... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailAutomationCompositionMigrationRollback2 :: Fail Migration of a... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | RollbackAutomationComposition2 :: Rollback of an automation compos... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailAutomationCompositionMigrationRollback3 :: Fail Migration of a... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailRollbackAutomationComposition :: Fail Rollback of an automatio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | UnInstantiateAutomationCompositionRollback2 :: Undeploy and Delete... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | FailDePrimeACDefinitionsFrom :: Fail DePrime automation compositio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinitionFrom :: DePrime and Delete automation compositio... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinitions :: DePrime and Delete automation composition d... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | DeleteACDefinitionTo :: DePrime and Delete automation composition ... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.Migration and Rollback Suite | FAIL | policy-csit | 48 tests, 46 passed, 2 failed policy-csit | ============================================================================== policy-csit | clamp.Tracing and Logs Suite policy-csit | ============================================================================== policy-csit | CheckTraces :: Verify that traces are being recorded in jaeger | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | CheckKafkaPresentInTraces :: Verify that kafka traces are being re... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | CheckHttpPresentInAcmTraces :: Verify that http traces are being r... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.Tracing and Logs Suite | PASS | policy-csit | 3 tests, 3 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp.Service Level Agreement Suite policy-csit | ============================================================================== policy-csit | WaitForPrometheusServer :: Sleep time to wait for Prometheus serve... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeForHealthcheck :: Validate component healthche... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeQueryAcDefinition :: Validate query AC Definit... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeQueryAcInstance :: Validate query AC instance ... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeQueryAcInstances :: Validate query all AC inst... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeStateChange :: Validate AC instance StateChang... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeCallParticipants :: Validate call AC participa... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeCommissioning :: Validate commission AC Defini... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeInstantiation :: Validate create AC Instance r... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeDeleteInstance :: Validate delete AC Instance ... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | ValidateResponseTimeDeleteDefinition :: Validate delete AC Definit... | PASS | policy-csit | ------------------------------------------------------------------------------ policy-csit | clamp.Service Level Agreement Suite | PASS | policy-csit | 11 tests, 11 passed, 0 failed policy-csit | ============================================================================== policy-csit | clamp | FAIL | policy-csit | 93 tests, 91 passed, 2 failed policy-csit | ============================================================================== policy-csit | Output: /tmp/results/output.xml policy-csit | Log: /tmp/results/log.html policy-csit | Report: /tmp/results/report.html policy-csit | RESULT: 2